Systems and methods for enhanced networking and remote communications

ABSTRACT

A system and method for medical communications is disclosed. The system and method may operate to receive, from a user communication node, an electronic signal comprising a communication request including a request description; select, from the list of network entities corresponding to third parties, one or more network entities based at least in part on (i) a parameter profile associated with a third party, and (ii) criteria extracted from the communication request including the request description; transmit an electronic signal, to one or more network entities, the communication request including the request description; receive an action from one of the selected network entities corresponding to third parties in response to the communication request; and provide an interactive communication panel to the user communication node and the one of the selected network entities to facilitate the real-time communication session.

CROSS-REFERENCE

This application claims the benefit of U.S Provisional Application No.63/125,809, filed Dec. 15, 2020, the entire contents of which is herebyincorporated by reference in its entirety.

BACKGROUND

Current telemedicine systems seek to facilitate communications betweenclinicians and patients in need of medical assistance. However, suchsystems have various technical deficiencies that make it difficult toprovide efficient and high quality care. For example, requests formedical assistance may be broadcast to nodes in a computer network in amanner that can result in inefficient traffic and/or routing over thenetwork for recipient users. These systems also lack integration ofpatient medical information with healthcare provider communications.

SUMMARY

Disclosed herein is a platform, system, method, and software whichenable healthcare providers (e.g., clinicians) to effectively andefficiently communicate with one another in non-emergency and emergencysituations. For example, the telemedicine systems disclosed herein helpleverage limited specialist resources to efficiently assist largepopulations. The telemedicine systems and methods should be flexible,scalable, and rapidly-deployable. This may be achieved by a distributedcare provider network supported by a vendor agnostic healthcaretechnology system of systems. In order to mitigate challenges during ahealthcare crisis, it would be desirable to provide a system with theability to rapidly put together a team of critical care physicians tosupport events from their current physical location.

The present disclosure is directed to an integrated system that allows adistributed network of healthcare providers to effectively andefficiently communicate securely in order to provide Tele Critical Caresupport. This system allows several forms of digital or electroniccommunications including messaging, notes, orders, and audio and videocommunication, in real-time and non-real time, using mobile devices suchas smartphones, tablets, or other computing devices to provide acutecare to hospitalized patients, and to address clinical emergencies, inreal-time across multiple hospitals. This system can provide anefficiently-organized matching mechanism to match the desired orappropriate health care provider(s) to a pending request for medicalassistance, and therefore create communication channel between theseclient nodes. The system can provide an intuitive device-agnosticmobile-friendly software platform usable on smartphones, tablets, andaudio-visual enabled web-based computers for on-demand bedside to remoteintensivist consultation and critical care decision support.

In some embodiments, the system may allow remote intensivists to performvideo assessment of patients, view bedside devices, interfaced vitalsigns, laboratory data, and/or exchange clinical information throughsecure messaging and audio-video communications to allow efficientcritical care support whenever and wherever it is needed.

In some embodiments, the system may be used to complete tele-consults,with the optional integration of medical devices and sensors, mayprovide a comprehensive remote patient monitoring solution. Eachadditional device that is incorporated may broaden the reach of the“device ecosystem” and may include wearables, wellness monitors, smartwatches, etc. to increase the chances that a population affected by adisaster would either 1) already be wearing a “physiology monitor” or 2)would have a compatible device included in a local healthcare systemresponse. The system may be able to gather data from environmentalsensors and other nonmedical sensors in order to provide additionalcontext to the scenario. In some embodiments, the system extracts rawdata from one or more of the disparate devices and sensors and maps thedata to a uniform template (see, e.g., FIG. 32 showing aggregation ofdata extracted from disparate devices and FIG. 29D showing the datamapped to a uniform template shown to a remote healthcare provider via amobile app dashboard). This can provide standardized data to facilitatea healthcare provider's evaluation of the patient status. The collectedand aggregated standardized data can be readily available for real timeanalysis and dashboards aiding in emergency management during thecrisis, and may provide information for retrospective analysis, qualityassurance, and training to improve care during future events. This datamay enable the development of force multiplying technologies such asremote control of devices and autonomous care systems.

Disclosed herein, in one aspect, is a computer-implemented method forproviding real-time healthcare communication, comprising: receiving, byone or more computer processors, from a client node, a request ofconsult describing a medical condition for a patient; selecting, by theone or more computer processors, from a list of healthcare providers,one or more healthcare providers based at least in part on (i) a profileassociated with healthcare provider, and (ii) criteria extracted fromthe request of consult; presenting, by the one or more computerprocessors, to the selected healthcare providers, the request ofconsult; receiving, by the one or more computer processors, an actionfrom one of the selected healthcare providers in response to the requestof consult; and providing, by the one or more computer processors, aninteractive communication panel to the client node for the patient andthe healthcare provider to facilitate the real-time healthcarecommunication. In some embodiments, (a)-(e) are performed by the one ormore computer processors in real-time. The method of claim 1, furthercomprising, prior to (a), maintaining, by the one or more computerprocessors, the list of healthcare providers and the profile associatedwith the list of healthcare providers. In some embodiments, (c) furthercomprises: broadcasting a notification of the request of consult to thelist of healthcare providers; and allow a healthcare provider from theselected healthcare providers to take over control when two or morehealthcare providers respond to the request of consult during a sametime window. In some embodiments, the request of consult comprises anacuity level. In some embodiments, further comprising, prior to (a),retrieving, by the one or more computer processors, a health recordassociated with the patient. In some embodiments, the criteria extractedfrom the request of consult comprises criteria extracted from the healthrecord associated with the patient. In some embodiments, furthercomprising, prior to (a), authenticating, by the one or more computerprocessors, credentials of the healthcare providers and their affiliatedhospitals. In some embodiments, an access to the health record isrestricted to the authenticated healthcare providers. In someembodiments, the real-time healthcare communication comprises messages,audio calls, video calls, orders, and notes. In some embodiments, (b)comprises applying a matching algorithm to the list of healthcareproviders to identify the one or more healthcare providers as suitablefor responding to the request for consult. In some embodiments, theinteractive communication panel for the client node and/or thehealthcare provider comprises a virtual dashboard displaying medicalinformation for the patient. In some embodiments, further comprisingconsolidating medical information for the patient from a plurality ofsources and providing the medical information to the client node and/orthe healthcare provider. In some embodiments, further comprisingcreating a team of healthcare providers suitable for responding to therequest for consult. In some embodiments, the team of healthcareproviders comprises a plurality of medical roles. In some embodiments,the healthcare provider is at a remote location not in proximity to thepatient. In some embodiments, selecting the one or more healthcareproviders comprises providing load balancing of workload for healthcareproviders to optimize the ratio of requests for consult to availableresources. In some embodiments, further comprising expanding selectionof the one or more healthcare providers by modifying a matchingalgorithm when the request for consult is not responded to within a timeduration. In some embodiments, the time duration is preset ordynamically set based on parameters comprising total number of requestsfor consult, availability of healthcare providers, average duration of aconsult, complexity of consult, individual provider efficiency, or anycombination thereof. In some embodiments, further comprising providingdata analytics to the client node and/or healthcare provider, optionallywherein the data analytics is displayed through a virtual command centerprovided to the client node and/or healthcare provider. In someembodiments, further comprising providing an augmented reality orvirtual reality display to the client node and/or healthcare provider.

In another aspect, disclosed herein is a non-transitorycomputer-readable medium comprising machine-executable code that, uponexecution by one or more computer processors, implements a method forproviding real-time graphically distinct items in a user experience,comprising: receiving, from a client node, a request of consultdescribing a medical condition for a patient; selecting, from a list ofhealthcare providers, one or more healthcare providers based at least inpart on (i) a profile associated with healthcare provider, and (ii)criteria extracted from the request of consult; presenting to theselected healthcare providers the request of consult; receiving, anaction from one of the selected healthcare providers in response to therequest of consult; and providing, an interactive communication panel tothe client node for the patient and the healthcare provider tofacilitate the real-time healthcare communication. In some embodiments,(a)-(e) are performed by the one or more computer processors inreal-time. In some embodiments, further comprising, prior to (a),maintaining, by the one or more computer processors, the list ofhealthcare providers and the profile associated with the list ofhealthcare providers. In some embodiments, (c) further comprises:broadcasting a notification of the request of consult to the list ofhealthcare providers; and allow a healthcare provider from the selectedhealthcare providers to take over control when two or more healthcareproviders respond to the request of consult during a same time window.In some embodiments, the request of consult comprises an acuity level.In some embodiments, further comprising, prior to (a), retrieving, bythe one or more computer processors, a health record associated with thepatient. In some embodiments, the criteria extracted from the request ofconsult comprises criteria extracted from the health record associatedwith the patient. In some embodiments, further comprising, prior to (a),authenticating, by the one or more computer processors, credentials ofthe healthcare providers and their affiliated hospitals. In someembodiments, an access to the health record is restricted to theauthenticated healthcare providers. In some embodiments, the real-timehealthcare communication comprises messages, audio calls, video calls,orders, and notes. In some embodiments, (b) comprises applying amatching algorithm to the list of healthcare providers to identify theone or more healthcare providers as suitable for responding to therequest for consult. In some embodiments, the interactive communicationpanel for the client node and/or the healthcare provider comprises avirtual dashboard displaying medical information for the patient. Insome embodiments, further comprising consolidating medical informationfor the patient from a plurality of sources and providing the medicalinformation to the client node and/or the healthcare provider. In someembodiments, further comprising creating a team of healthcare providerssuitable for responding to the request for consult. In some embodiments,the team of healthcare providers comprises a plurality of medical roles.In some embodiments, the healthcare provider is at a remote location notin proximity to the patient. In some embodiments, selecting the one ormore healthcare providers comprises providing load balancing of workloadfor healthcare providers to optimize the ratio of requests for consultto available resources. In some embodiments, further comprisingexpanding selection of the one or more healthcare providers by modifyinga matching algorithm when the request for consult is not responded towithin a time duration. In some embodiments, the time duration is presetor dynamically set based on parameters comprising total number ofrequests for consult, availability of healthcare providers, averageduration of a consult, complexity of consult, individual providerefficiency, or any combination thereof. In some embodiments, furthercomprising providing data analytics to the client node and/or healthcareprovider, optionally wherein the data analytics is displayed through avirtual command center provided to the client node and/or healthcareprovider. In some embodiments, further comprising providing an augmentedreality or virtual reality display to the client node and/or healthcareprovider.

Disclosed herein, in another aspect, is a system comprising a networkcommunication element, one or more computer processors, andnon-transitory computer readable storage medium comprisingmachine-executable instructions that, upon execution by the one or morecomputer processors, causes the one or more computer processors to: (a)receive, from a client node, a request of consult describing a medicalcondition for a patient; (b) select, from a list of healthcareproviders, one or more healthcare providers based at least in part on(i) a profile associated with healthcare provider, and (ii) criteriaextracted from the request of consult; (c) present to the selectedhealthcare providers the request of consult; (d) receive, an action fromone of the selected healthcare providers in response to the request ofconsult; and (e) provide, an interactive communication panel to theclient node for the patient and the healthcare provider to facilitatethe real-time healthcare communication. In some embodiments, (a)-(e) areperformed by the one or more computer processors in real-time. In someembodiments, prior to (a), maintain, by the one or more computerprocessors, the list of healthcare providers and the profile associatedwith the list of healthcare providers. In some embodiments, (c) furthercomprises: broadcast a notification of the request of consult to thelist of healthcare providers; and allow a healthcare provider from theselected healthcare providers to take over control when two or morehealthcare providers respond to the request of consult during a sametime window. In some embodiments, the request of consult comprises anacuity level. In some embodiments, further comprising, prior to (a),retrieve, by the one or more computer processors, a health recordassociated with the patient. In some embodiments, the criteria extractedfrom the request of consult comprises criteria extracted from the healthrecord associated with the patient. In some embodiments, furthercomprising, prior to (a), authenticate, by the one or more computerprocessors, credentials of the healthcare providers and their affiliatedhospitals. In some embodiments, an access to the health record isrestricted to the authenticated healthcare providers. In someembodiments, the real-time healthcare communication comprises messages,audio calls, video calls, orders, and notes. In some embodiments, (b)comprises applying a matching algorithm to the list of healthcareproviders to identify the one or more healthcare providers as suitablefor responding to the request for consult. In some embodiments, theinteractive communication panel for the client node and/or thehealthcare provider comprises a virtual dashboard displaying medicalinformation for the patient. In some embodiments, further comprisingconsolidating medical information for the patient from a plurality ofsources and providing the medical information to the client node and/orthe healthcare provider. In some embodiments, further comprisingcreating a team of healthcare providers suitable for responding to therequest for consult. In some embodiments, the team of healthcareproviders comprises a plurality of medical roles. In some embodiments,the healthcare provider is at a remote location not in proximity to thepatient. In some embodiments, selecting the one or more healthcareproviders comprises providing load balancing of workload for healthcareproviders to optimize the ratio of requests for consult to availableresources. In some embodiments, further comprising expanding selectionof the one or more healthcare providers by modifying a matchingalgorithm when the request for consult is not responded to within a timeduration. In some embodiments, the time duration is preset ordynamically set based on parameters comprising total number of requestsfor consult, availability of healthcare providers, average duration of aconsult, complexity of consult, individual provider efficiency, or anycombination thereof. In some embodiments, further comprising providingdata analytics to the client node and/or healthcare provider, optionallywherein the data analytics is displayed through a virtual command centerprovided to the client node and/or healthcare provider. In someembodiments, further comprising providing an augmented reality orvirtual reality display to the client node and/or healthcare provider.

In another aspect, disclosed herein is a computer-implemented method forproviding a real-time network communication session, comprising: (a)receiving, by one or more computer processors, from a user communicationnode, an electronic signal comprising a communication request includinga request description; (b) selecting, by the one or more computerprocessors, from a list of network entities corresponding to thirdparties, one or more network entities based at least in part on (i) aparameter profile associated with a third party, and (ii) criteriaextracted from the communication request including the requestdescription; (c) transmitting an electronic signal, by the one or morecomputer processors, to one or more network entities, the communicationrequest including the request description; (d) receiving, by the one ormore computer processors, an action from one of the selected networkentities corresponding to third parties in response to the communicationrequest; and (e) providing, by the one or more computer processors, aninteractive communication panel to the user communication node and theone of the selected network entities to facilitate the real-timecommunication session. In some embodiments, further comprisingaggregating data related to the criteria from a plurality of datasources and processing the data according to a standard format. In someembodiments, further comprising performing data analytics on the data togenerate a suggestion for one or more actions. In some embodiments,performing data analytics comprises processing the data using a machinelearning algorithm. In some embodiments, the interactive communicationpanel provides a graphical user interface shown on an interactivetouchscreen display. In some embodiments, the interactive communicationpanel provides an augmented reality video feed between the usercommunication node and the one of the selected network entities. In someembodiments, further comprising providing tracking of an object shown inthe augmented reality video feed. In some embodiments, the object istracked using a computer vision algorithm trained to detect and trackthe object. In some embodiments, the computer vision algorithm comprisesan image segmentation algorithm or a machine learning algorithm. In someembodiments, the machine learning algorithm is a deep convolutionalneural network. In some embodiments, the user communication node is aclient node. In some embodiments, the communication request comprising arequest description is a request of consult describing a medicalcondition of a patient. In some embodiments, a network entity of a thirdparty is a communication device of a remote healthcare provider.

Disclosed herein, in another aspect, is a system comprising a networkcommunication element, one or more computer processors, andnon-transitory computer readable storage medium comprisingmachine-executable instructions that, upon execution by the one or morecomputer processors, causes the one or more computer processors to: (a)receive, by one or more computer processors, from a user communicationnode, an electronic signal comprising a communication request includinga request description; (b) select, by the one or more computerprocessors, from a list of network entities corresponding to thirdparties, one or more network entities based at least in part on (i) aparameter profile associated with a third party, and (ii) criteriaextracted from the communication request including the requestdescription; (c) transmit an electronic signal, by the one or morecomputer processors, to one or more network entities, the communicationrequest including the request description; (d) receive, by the one ormore computer processors, an action from one of the selected networkentities corresponding to third parties in response to the communicationrequest; and (e) provide, by the one or more computer processors, aninteractive communication panel to the user communication node and theone of the selected network entities to facilitate the real-timecommunication session. In some embodiments, further comprisingaggregating data related to the criteria from a plurality of datasources and processing the data according to a standard format. In someembodiments, further comprising performing data analytics on the data togenerate a suggestion for one or more actions. In some embodiments,performing data analytics comprises processing the data using a machinelearning algorithm. In some embodiments, the interactive communicationpanel provides a graphical user interface shown on an interactivetouchscreen display. In some embodiments, the interactive communicationpanel provides an augmented reality video feed between the usercommunication node and the one of the selected network entities. In someembodiments, further comprising providing tracking of an object shown inthe augmented reality video feed. In some embodiments, the object istracked using a computer vision algorithm trained to detect and trackthe object. In some embodiments, the computer vision algorithm comprisesan image segmentation algorithm or a machine learning algorithm. In someembodiments, the machine learning algorithm is a deep convolutionalneural network. In some embodiments, the user communication node is aclient node. In some embodiments, the communication request comprising arequest description is a request of consult describing a medicalcondition of a patient. In some embodiments, a network entity of a thirdparty is a communication device of a remote healthcare provider.

Disclosed herein, in another aspect, is a system comprising a networkcommunication element, one or more computer processors, andnon-transitory computer readable storage medium comprisingmachine-executable instructions that, upon execution by the one or morecomputer processors, causes the one or more computer processors to: (a)receive from a user communication node, an electronic signal comprisinga communication request including a request description; (b) select froma list of network entities corresponding to third parties, one or morenetwork entities based at least in part on (i) a parameter profileassociated with a third party, and (ii) criteria extracted from thecommunication request including the request description; (c) transmit anelectronic signal to one or more network entities, the communicationrequest including the request description; (d) receive an action fromone of the selected network entities corresponding to third parties inresponse to the communication request; and (e) provide an interactivecommunication panel to the user communication node and the one of theselected network entities to facilitate the real-time communicationsession. In some embodiments, further comprising aggregating datarelated to the criteria from a plurality of data sources and processingthe data according to a standard format. In some embodiments, furthercomprising performing data analytics on the data to generate asuggestion for one or more actions. In some embodiments, performing dataanalytics comprises processing the data using a machine learningalgorithm. In some embodiments, the interactive communication panelprovides a graphical user interface shown on an interactive touchscreendisplay. In some embodiments, the interactive communication panelprovides an augmented reality video feed between the user communicationnode and the one of the selected network entities. In some embodiments,further comprising providing tracking of an object shown in theaugmented reality video feed. In some embodiments, the object is trackedusing a computer vision algorithm trained to detect and track theobject. In some embodiments, the computer vision algorithm comprises animage segmentation algorithm or a machine learning algorithm. In someembodiments, the machine learning algorithm is a deep convolutionalneural network. In some embodiments, the user communication node is aclient node. In some embodiments, the communication request comprising arequest description is a request of consult describing a medicalcondition of a patient. In some embodiments, a network entity of a thirdparty is a communication device of a remote healthcare provider.

In some embodiments, the system includes a platform and application withone or more of the following in any combination:

An integrated communication interface (audio, video, text, etc.) betweenhealthcare providers across multiple locations and hospitals for theprovision of patient care in real time related to acute care andemergencies.

Provide synchronous (audio/video) and asynchronous(text/messaging/email)communications.

Comprehensive system that organizes healthcare providers intoconfigurable remote teams based on real time demand and workflowoptimization with integrated workflow management and workloaddistribution.

A process for presenting a customized user interface to each provider,e.g., depending on their role or customization settings.

A system to initiate, manage, and document communications acrosshealthcare providers.

A system to recruit, assign, and bring online clinical staff withinminutes.

Provide real-time clinical data (e.g., vital signs, laboratory results,device monitoring, etc.) for medical decision making.

A combination of real-time clinical data, patients and patient careteams, and team communication.

Secure access to patient data.

Provide real-time data collection for real-time and retrospectiveanalysis.

Provide triage point for self-enrolling patients.

Provide clinical decision support tools and training tools to providers.

Provide resources such as cognitive aids, clinical and technicalreferences, care plans and best practices which can be downloaded to asmart phone long before an emergency occurs and automatically updated ona regular basis.

A system to collect and aggregate standardized data which may be readilyavailable for real-time analysis and dashboards aiding in emergencymanagement during the crisis, and which may provide information forretrospective analysis, quality assurance, and training to improve careduring future events.

A system to aggregate historical data for retrospective analysis, and amechanism to utilize retrospective analysis to build a model which mayi) provide better matching between healthcare provider and patient inneed of medical assistance; ii) provide recommended or suggestedmedication or tests or clinical reassessment/ follow up in a certainsituation (e.g., based on vital signs, laboratory results, or devicemonitoring data, etc.); iii) provide actionable insights for developerto build additional tools for the telemedicine platform, etc.

INCORPORATION BY REFERENCE

All publications, patents, and patent applications mentioned in thisspecification are herein incorporated by reference to the same extent asif each individual publication, patent, or patent application wasspecifically and individually indicated to be incorporated by reference.

BRIEF DESCRIPTION OF THE DRAWINGS

A better understanding of the features and advantages of the presentdisclosure can be obtained by reference to the following detaileddescription that sets forth illustrative embodiments, in which theprinciples of the disclosure are utilized, and the accompanying drawingsof which:

FIG. 1 is a view of a device displaying teams of providers spanningmultiple hospitals across disparate physical locations, according to oneor more embodiments herein.

FIG. 2 is a view of the device of FIG. 1 providing a user interface fordisplaying and receiving information for local medical providers orclinicians, according to one or more embodiments herein.

FIG. 3 is a view of the device of FIG. 1 providing a user interface fordisplaying and receiving information for local medical providers orclinicians, according to one or more embodiments herein.

FIG. 4 is a view of the device of FIG. 1 providing a local medicalprovider's (in this example, a nurse) patient care message to a remotemedical provider or clinician, according to one or more embodimentsherein.

FIG. 5 is a view of the device of FIG. 1 providing real-timecommunication between remote and local medical providers or clinicians,according to one or more embodiments herein.

FIG. 6 is a view of the device of FIG. 1 providing a user interface fordisplaying and receiving information for remote medical providers orclinicians, according to one or more embodiments herein.

FIG. 7 is a view of the device of FIG. 1 providing a remote medicalprovider's order or note for a local provider (in this example, anurse), according to one or more embodiments herein.

FIG. 8 is a view of the device of FIG. 1 for receiving a patient'smedical information, according to one or more embodiments herein.

FIG. 9 is a view of the device of FIG. 1 for remote viewing andinteraction between a patient and a remote medical provider orclinician, according to one or more embodiments herein.

FIG. 10 is a schema of the flow of information between local medicalproviders and remote medical providers or clinicians, according to oneor more embodiments herein.

FIG. 11 is a schematic drawing of a process for local telemedicine,according to one or more embodiments herein. As used in this context,messages that are sent and accepted by a healthcare provider refer toconsults or requests for consults.

FIG. 12 is a schematic drawing of workflow process for remotetelemedicine, according to one or more embodiments herein. As used inthis context, messages that are sent and accepted by a healthcareprovider refer to consults or requests for consults.

FIG. 13 is a schematic drawing of a system for telemedicine, accordingto one or more embodiments herein.

FIG. 14 shows a high-level overview of a telemedicine system, accordingto one or more embodiments herein.

FIG. 15 shows a schematic drawing of a system for telemedicine includinga distributed architecture, according to one or more embodiments herein.

FIG. 16 shows a schematic drawing of the cloud and near patientcomponents of a telemedicine system, according to one or moreembodiments herein.

FIG. 17 shows a schematic drawing of a virtual data space connectingvarious components of the telemedicine system, according to one or moreembodiments herein.

FIG. 18 shows a schematic drawing of a cloud coordinator's capabilities,according to one or more embodiments herein.

FIG. 19 shows a schematic drawing of a virtual command center, accordingto one or more embodiments herein.

FIG. 20 shows a schematic drawing of physical components of atelemedicine system, according to one or more embodiments herein.

FIG. 21 shows a view of a user interface for a command center dashboard,according to one or more embodiments herein.

FIG. 22 shows a view of a user interface for an administrator portalhospital management tool, according to one or more embodiments herein.

FIG. 23 shows a view of a user interface for an administrator portalhospital management tool with manual location entry pop-up window open,according to one or more embodiments herein.

FIG. 24 shows a view of a user interface for an administrator portalprovider management tool, according to one or more embodiments herein.

FIG. 25 shows a schematic drawing of a system for data collection andmanagement using a telemedicine system, according to one or moreembodiments herein.

FIG. 26 shows an architecture for the telemedicine platform, accordingto one or more embodiments herein.

FIG. 27 is a block diagram depicting an example system, according toembodiments of the present disclosure, comprising a client-serverarchitecture and network configuration to perform the various methodsdescribed herein.

FIG. 28A and FIG. 28B provide illustrative diagrams showing theimplementation of augmented reality for a virtual real-time consultbetween a healthcare provider and a patient, according to one or moreembodiments herein.

FIG. 29A, FIG. 29B, FIG. 29C, and FIG. 29D show a sequence of viewsillustrating the consultation initiation process, according to one ormore embodiments herein. FIG. 29A shows a list of consults for a remotehealthcare provider as shown on a smartphone display. FIG. 29B showspatient information including the associated hospital and the unit ofthe hospital (in this case, ICU). FIG. 29C shows the capability andinterface to connect to a device associated with the patient. FIG. 29Dshows a dashboard with medical data for the patient mapped fromdisparate sources, including in this illustrative example, demographics(age, gender), location, disease or condition, details, and real-time ornear real-time vitals (heart rate, blood pressure, RR, SPO2,temperature, AVPU, supplemental oxygen status, and FiO2.

FIG. 29E shows a view of a dashboard with an eConsults feature forinitiating an electronic consult by inputting relevant patientinformation for a consult request to be sent to a remote provider'squeue, a patient census feature for the patient (which allows initiationof the consultation by selecting a particular patient), a providerdirectory allowing access to the list of remote healthcare providersavailable as on-call (e.g., indicated by a status indicator such as agreen icon), and eRequests which allows routine requests such as PRNmedications, labs, and other such requests to be sent from bedsideclinicians in a different category to enhance the remote provider'sworkflow and streamline such requests for bedside clinicians. Thisdesignation can further help remote healthcare providers to prioritizeworkload.

FIG. 30 shows a command center dashboard with a window for completion ofa consult by a remote healthcare provider, including notes such asassessment details and plan details for the patient, according to one ormore embodiments herein.

FIG. 31 shows a schematic drawing of a telemedicine system illustratingthe relationships between the bedside clinicians and remote healthcareproviders and the functionality provided by the telemedicine system tofacilitate communications, according to one or more embodiments herein.

FIG. 32 shows a schematic drawing of an integrated communicationsplatform that aggregates health data from disparate devices to provideenhanced communications for telemedicine, according to one or moreembodiments herein.

FIG. 33 shows a command center dashboard displaying medical data for alist of patients, according to one or more embodiments herein.

FIG. 34A shows a data analytics chart depicting a timeline of consultresponse times for different hospitals, according to one or moreembodiments herein. FIG. 34B shows data analytics as part of acustomizable patient report including a chart depicting COVID positivepatients and a chart depicting patient acuity level, according to one ormore embodiments herein.

FIG. 35 shows an illustrative example of a list of consult dataexportable in CSV format, according to one or more embodiments herein.

DETAILED DESCRIPTION

Disclosed herein are platforms, systems, methods, and software forproviding an integrated telemedicine system and network that facilitatescommunications between healthcare providers and patients who are locatedremotely from one another. There exists a lack of such an integrated,comprehensive telemedicine system that may bridge healthcare providerand patients in need of medical assistance. During public healthemergencies medical services need to rapidly mobilize. During thismobilization, information is constantly changing, new information needsto be gathered as it evolves, and disseminated to local and remote careproviders and other agencies. Often these emergencies occur withoutwarning.

The platforms, systems, methods, and software disclosed herein providevarious advantages that address deficiencies in the current state oftelemedicine and medical communications. Clinicians use telemedicine toevaluate, diagnose, treat, and monitor patients with audio and videotechnologies. A computer network for telemedicine may facilitate theexchange and/or delivery of data packets, or communications, betweenmultiple client nodes associated with healthcare providers and patientin need of medical assistance. Often, a data packet containing a requestfor medical assistance may be broadcast to all nodes in the computernetwork. However, this may create unnecessary traffic over the networkand an overload of information for the recipient users. Additionally, inthe field of healthcare, the healthcare providers' specialties andavailabilities may need to be taken into consideration when matching arequest for medical assistance with a healthcare provider. Accordingly,in some embodiments, disclosed herein is a platform, system, method, andsoftware that provides a market-based environment in which requests orconsults are transmitted by patients to pre-filtered or screened networkof nodes for healthcare providers who are remotely located from thepatient and who can accept or claim the requests or consults at theirdiscretion. The request or consult may be configured with one or moreparameters for screening for the appropriate healthcare provider (e.g.,specifying an area of specialization). Alternatively or in combination,the healthcare provider may also configure their profile or consultconfigurations to screen the requests or consults (e.g., removingconsult requests involving certain medical conditions that are betterevaluated by a different type of specialist).

Existing telemedicine systems for providing care to hospitalizedpatients use dedicated fixed hardware with disparate systems for theevaluation and treatment of patients by both local and remote healthcareproviders. Such disparate systems lack the integration of patientmedical information with healthcare provider communications. Further,healthcare providers using such hardware and disparate systems do so inphysical medical workspaces and communication centers which can causedelays in communicating healthcare information and solutions and canalso inhibit the recordation and communication of accurate and timelypatient status and solutions to immediate and near-term patient healthconcerns. Healthcare providers lack a mobile and expansive mechanism forsecure access to medical data integrated with remote communicationacross multiple hospitals to provide. Accordingly, in some embodiments,disclosed herein is a platform, system, method, and software thatprovides integration of medical information with remote communicationsacross various healthcare settings such as hospitals and clinics toenable efficient bridging of healthcare providers with patients in orderto give providers access to relevant medical information and facilitatereal-time communications of healthcare solutions.

Additionally, there currently exists a lack of infrastructure to quicklyrespond to natural disasters, mass casualty events, and other medicalemergencies. During public health emergencies medical services may needto be rapidly mobilized. During this mobilization, information isconstantly changing, new information needs to be gathered as it evolves,and disseminated to local and remote care providers and other agencies.Often these emergencies occur without warning. The national response toCOVID-19 has highlighted the fragility of healthcare systems. Theinitial response has demonstrated the need for skilled care providersand resources to support them, in both urban and rural areas, when localresources are overwhelmed or unavailable. Healthcare providers may beconfronted by unfamiliar situations, disease processes, and unfamiliarequipment or equipment shortages. These challenges are compounded asmost critical care physicians are in high population urban areas,leaving rural and smaller hospitals lacking the experience andtechnology to manage large volumes of patients. The resources availableto healthcare providers and critical care response teams are currentlyless than ideal.

Accordingly, the platforms, systems, methods, and software describedherein may be part of an emergency preparedness system able to provideresources such as cognitive aids, clinical and technical references,care plans and/or best practices which can be downloaded to a smartphone long before an emergency occurs and automatically updated on aregular basis. These resources will be invaluable at the time of anemergency when cellular networks may be saturated or there is noconnection to the outside world. It may also include clear instructionsto local care providers on the assigned tasks with full awareness of howthese tasks fit in the overall telemedicine workflow.

In cases where patients require monitoring, telemonitoring can beprovided by using the patient's own personal health device, if they arewearing one, or with wireless body sensors that can be rapidly broughtto the location of the event. An integrated clinical environmentplatform may be used to integrate multiple sensors, actuators, andmedical devices from different vendors and to ensure the documentationof frequent spot checks or continuous stream of physiological data. Thisdata can be directly used by the local care team to augment localdecision making, and/or by remote care experts, who can remotely monitorand/or silence alarms, change device settings, and/or directly care forpatients while the local care team assists other patients. The data maybe beneficial both to the local care team by reducing their workload andmost importantly to the patient. There is also a need for local supportand sharing of information. Frequently large-scale emergencies areproviding critical care in environments with limited communicationinfrastructure or where a hospital's traditional infrastructure is tooslow or unavailable.

The platforms, systems, methods, and software disclosed herein canprovide one or more of the following features:

Secure on-demand audio and video calls

Patient-centric synchronous messaging

Photo and file sharing

Provider directory and patient census displays

Multi-user conference calling

Structured electronic patient handoff

Prioritization features (e.g., urgency flagging, SOS feature)

In addition, enhanced documentation can be provided throughpre-populated basic templates, completion/summary notes, the ability tostore and export messages and/or notes into EMR, or any combinationthereof.

Clinical data can also be provided during the consultation process. Forexample, a dashboard can be provided at the client node and/or with theremote healthcare provider (e.g., via a mobile app) that shows one ormore of:

Real-time vitals display

Graphic display of trends in vitals and labs

Patient acuity status

Option for manual data entry

Option for integration (EMR integration, Medical Device DataAggregation)

Additional capabilities include administrative portal features (e.g.,portal or dashboard accessible by an admin) such as:

ADT patient list integration

Upload of patient list

Manual addition of patients

Provider verification and approval

Hospital onboarding

Send system alerts to users

In some embodiments, the dashboard provides analytics features such asone or more of:

Track patient and consultation volume by location

Visualize patient acuity on a local and regional level

Metrics on average response time, provider capacity

BI Report generation capabilities

Additional clinical metrics as requested by client on an individualbasis

FIG. 1 shows a view of a mobile computer 100, such as a tablet, smartphone, or laptop displaying an initial view for a remote physician orhealthcare provider when they are logged in to the system. This personmay be at a remote location relative to various patients who may be atdisparate hospitals and clinics or even at a non-medical location, forexample, a long-term care facility such as a nursing home or simply athome. On the left side the tablet 100 may include a list 102 of varioushospitals who are subscribed and connected to a network and, under eachhospital, each team 104 a, 104 b, 104 c, 104 d, 104 e assigned to eachhospital of the list 102.

Referring now to FIG. 2, there is shown the device 100 displaying aninterface 202 for a local medical provider, such as a Nurse. The device100 may display such an interface 202 to facilitate logging into thesystem through the device 100. The device 100 may include an interfacehaving a list of patients 204 and interface elements 206, such as acheck box, beside each patient name in the list of patients 204. Thesystem may receive information from a medical practitioner, such as anurse, through the interface elements 206, which, for example, allow thenurse to select out the patients they will be caring for during a shift.In some cases, there is a parallel process for selecting the patientsthe bedside clinician needs consults for. The right pane 208 of theinterface 202 may show communication exchanges between the nurse andother healthcare providers, including physicians, other nurses, andphysicians' assistants. The device 100 may also include an interfaceelement 210, such as a tab, that allows users to sort messages by date,time, or name and may also include a message flag 212 that can indicatewhether a particular message is urgent or not. In some cases, themessage or request for consult comprises an urgency level such as, forexample, routine, urgent, or emergency (e.g., SOS). The response time ortime duration for the request for consult may be adjusted based on theurgency level. For example, routine consult requests may have a 1 hourmaximum response time, while urgent has 30 minutes response time, andemergency requires immediate attention. Thus, a bedside provider such asa nurse may prioritize the consult request by setting the level ofurgency, which helps the remote provider to prioritize their ownworklist if multiple consults are received in a short time frame, forexample, by filtering according to urgency status. In the case of anemergency, the consult request or message with the emergency status maycause the application (e.g., mobile app used by remote clinicians) toalert all online/active remote healthcare providers that a bedsideclinician needs assistance. The device 100 may also include a messagefield 214 that contains patient information, such as the patient'slocation, bed number, and other identifying and localizing information.The device 100 may also include a notification field 216 for newincoming orders for the nurse. The device may also include an indication218 of a change in message status visible to nurse. The indication 218may indicate, for example, when a message is accepted by a doctor.

Communications between nurses and other providers, namely other nurses,physician's assistants and doctors, may be in the form of messages(e.g., in-app messaging or via external text messaging systems),audio-video calls (e.g., in-app calls or to an external phone number),orders, notes, and the like. Messages may be a broadcast entity that maybe initiated by nurses, physicians, or other providers in the system(e.g., administrators, etc.). These messages can be exchanged as part ofa consult, for example, before, during, or after a consult has beenaccepted or claimed by a remote healthcare provider (e.g., clinician).Audio-video calls are targeted entities and may be initiated by oneperson to another individual or a group of providers. Orders may bewritten by doctors or Physician's Assistants and can be processed bynurses. Notes include documenting comments that a doctor or aphysician's assistant may wish to add about the patient, etc. Allcommunication happens in the context of a patient. Further, allcommunication can be tagged with time-stamps. In some embodiments,communications may typically be arranged chronologically. In someembodiments, communications may be sorted by patient name or urgencystatus. A message highlighted in color may indicate an urgent messagebroadcast by nurses to other healthcare providers. Each message filed214 can include unique patient identifying information in the context oftheir location within a healthcare system. This may help with auditingthe care provided to the patient and avoid errors.

In more detail, still referring to FIG. 2, the device 100 may include anotification mechanism for incoming messages, orders or notes fromphysicians that show up as alerts in the upper right-hand corner in thenotification field 216. The remote healthcare provider may receivenotifications of a request of consult through various mechanisms, forexample, by push notification if on a mobile device, an out-of-app SMSalert, a direct phone call (video or audio), a browser pop up thatflashes across the screen on a web-based platform (optionally remainsvisible as a notification).

In some embodiments, the user interface of the device described abovemay represent the first screen that is presented to a local medicalpractitioner, such as a nurse, when they log into the system. The nursemay be presented with a list of patients in their specific hospital unitin a specific hospital. This information may be extracted or receivedfrom the hospital's electronic medical record (EMR) and/oradmission-discharge-transfer (ADT) database, as shown in and describedbelow, particularly with reference to FIG. 13. Hospital databasescontain specific information about a patient including physical locationwithin the hospital, name, gender, and medical record number. Thisinformation may be made available through an Electronic Medical Recordinterface engine. An interface engine may connect systems throughindustry-specific protocols (e.g., HL7). The role of the interfaceengine may be to extract, exchange, and/or share electronic healthrecord information between hospital systems. The interface engine mayfind patients in hospital units electronically by querying a hospitaldatabase and, after extracting the desired patient information, maytransfer such data to a data repository 1302 (see FIG. 13), such as adatabase located within the system (see, e.g., FIG. 13) as describedherein. The system may then take this information and display it in theformat described in FIG. 3 for the user, such as a nurse.

The nurse may have the ability to select patients for self-assignmentbased on the hospital's practices. More than one bedside provider (e.g.,nurse) can assign themselves the care of a patient to enable nurses totake breaks, change shifts, or to balance workload. In some embodiments,once a bedside healthcare provider has selected their patients, thesystem may display those patients on the left pane list of patient 204for this bedside healthcare provide, e.g., a nurse. These patients maybe only those patients that a bedside healthcare provider has to tend.In some embodiments, a drop-down menu may allow the bedside provider toview all the patients in the hospital unit if required.

In more detail, still referring to FIG. 2, the right pane 208 shows thecommunications that have occurred in the context of all patients in thehospital unit to which a bedside provider is assigned. When a bedsidehealthcare provider communicates with a remote provider (e.g.,intensivist) in the context of a specific patient, they can select thepatient name with either a touch action or a click action, and thencompose a broadcast message via the patient specific screen shown inFIG. 3.

Referring now to FIG. 3, the device 100 is shown in a messagecomposition configuration. The configuration may include an indication302 of the patient's name and an interface for communicating status ofand information related to the status of the patient. For example, thedevice may include a stylus input 304 for receiving an input foractivating a text or written message composition interface and an AVCall input 306 for receiving an input for activating an audio or videomessage composition interface for recorded or real-time audio or videomessaging. In addition, the device may include an order detail display308 for a patient which contains detailed instructions for the bedsideprovider from the remote provider with regards to the patient situation.

Referring now to FIG. 3, when a nurse or other health care practitionerwants to compose a message, the user can interact with the stylus input304 or the AV Call input 306, for example, by clicking or tapping on oneof the inputs 304, 306. The device may receive this input and thenactivate the appropriate message interface. For example, the composingof the message may be achieved by selecting on the stylus icon 304 onthe upper right-hand corner shown in FIG. 3. Composing while inside apatient specific screen may allow communications to occur in the contextof a particular patient. In some cases, the messages are sent and/orreceived in real-time. The messaging system can also provide multimediamessaging that allows digital files to be transmitted, such asphotographs or pictures, audio, and video.

Referring now to FIG. 4, the device 100 is shown in the message entrystate as viewed by local/bedside medical provider such as a nurse. Herethe device displays a message 402 composed by a bedside provider in astandardized format with headers permitting the doctor to easilyidentify the nature of the patient care issue. In some embodiments, anurse can compose a free-form message for broadcast though a free textinput interface accessed through the free text element 404. In someembodiments, the standard format, may be a default or the onlyinterface.

Referring now to FIG. 5, the device is shown in the audio-videocommunication state. On the left side is a list of remote medicalproviders 502 who might be available for the local medical provider(e.g., bedside healthcare provider) to communicate with using eitheraudio or video calls. On the right side are, for example, the localimage (i.e., local to the patient such as a live audio or video feedfrom a nurse) 504 and remote image (i.e., remote to the patient such asa live audio or video feed from a doctor) 506 that are seen in real timeby the parties participating in a video call.

Referring now to FIGS. 6 through 9, which show the user interfaces ofsystem 1300 for a remote doctor or physician's assistant, referred tohere as the provider. FIG. 6 shows the interface displayed on the device100 as seen by the provider when they log into the system 1300. Aprovider may be assigned, either by themselves or by one or morehospitals, to one or more teams 602. Each team 602 may be responsiblefor a hospital and the unit within that hospital. Therefore, this leftside pane may display a list of all the hospital locations and teamsthat a provider is associated with. For example, Hospital in Location 1,shown in FIG. 6 may have 3 provider teams assigned to it (labelled TeamA, Team B and Team C). This will allow the provider to see whichhospitals they are interacting with and also other providers (peers) whoare concomitantly responding to needs of those hospitals within a team.Since a provider may be associated with multiple hospitals, messagessent from those hospitals can all be displayed for that provider. Asshown in FIG. 6, message 1 can be a message from Hospital Location 1 andmessage 2 can be a message from Hospital Location 2. The right pane maydisplay all of the messages that have been sent by the local medicalprovider such as a nurse in the context of different patients fromdifferent hospitals.

In some embodiments, before connecting to the local or bedside providersuch as a clinician or nurse, the remote healthcare provider is able toopen the software (mobile app, website, etc.) and view the consultationrequest. They can then click on the patient's name and see demographicinformation, chief complaint, and available clinical data. Based on thepatient data, the software can automatically calculate a National EarlyWarning Score (NEWS) and display a corresponding acuity level of low,medium, or high—thus giving the remote provider immediate, high-levelcontext on the patient status. In some cases, to accept the consult, theremote provider can click “Accept” and the local provider is immediatelynotified that a remote healthcare provider has accepted the consultrequest. The remote healthcare provider can then click the “Messages”button to enter the app's messaging interface, where communication withthe bedside clinician (local provider) can be performed via writtenmessages, audio/visual calls, and/or shared files and images.

FIG. 7 is further detail showing the Order or Note entry state for theinterface with the system. This is the interface through which aprovider may enter their notes and orders 702 for a patient in responseto a message for that patient.

FIG. 8 shows an individual patient level detail screen 802 showingpatient data 804 on the device 100. The clinical data 814 can beorganized by systems, such as respiratory, hemodynamics, Cardiovascularand blood cases, as shown. The tab 804 labelled EMR may allow theprovider to access medical records, the History tab 806 may show allmessages in the context of that particular patient, the Dashboard tab808 may show further clinical data for a patient, the Notes tab 810 maydisplay notes written by a provider for a patient, and the Message tab812 may display the messages received in the context of that patient.Additionally, the AV Call input 816 may facilitate an audio or videocall between a bedside healthcare provider (or the patient) and adoctor.

FIG. 9 shows the device 100 with an interface that includes a live,delayed, or recorded video or image 902 of a patient in their room asvisible to the remote provider. The interface can also include a live,delayed, or recorded video or image 904 of a provider. This interfacemay be accomplished via the interface, or, alternative or additionally,by Virtual Reality (VR) devices.

FIG. 11, shows an embodiment of a process 1100 with which alocal/bedside medical provider, such as a nurse, may undertake when theywish to communicate with a remote doctor or a physician's assistant.First, the local provider may broadcast a message 1102 in the context ofan individual patient through the system which can be viewed on thescreen (FIG. 3). The local provider can also see if a message that theyhave broadcast on behalf of a patient has been “Accepted” for action bya remote doctor or a physician's assistant as shown by indication 218 inFIG. 2. If a message has not been “Accepted” for action by a remotedoctor after a particular duration, the bedside provider can choose tobroadcast the message again or initiate an audio-video call 1104 withthe remote doctor as shown in FIG. 11. Further, the local medicalprovider can view the list 502 (see FIG. 5) of remote medical providers1106 associated with a hospital unit and are available. In order toinitiate a call, the bedside provider may tap on the remote providername 502 on the left side and a call (audio or video) may be madebetween the two parties. The call itself may initiate a screen thatshows the information of both parties and may optionally use thefront-side cameras of the devices being used for the communication.

Referring to FIG. 2, when a doctor responds to a message or anaudio-video call in the context of a nurse, they can write an Order orNote on behalf of that patient through the interface shown in FIG. 7.Once the Order or Note is submitted, the nurse may be notified via analert about the new Order or Note as seen in FIG. 2 (e.g., vianotification field 216), details of which will display as shown in FIG.3 (e.g., via order detail display 308). The nurse can then act on theOrder. If there are further issues to be dealt with regarding the samepatient, the nurse may either broadcast a new message or initiate a newaudio-video call. All outbound messages, notes and orders pertaining toa particular patient, may be displayed chronologically in the right paneof that patient's screen on the nurse's dashboard as seen in FIG. 3.

FIG. 10 describes the flow of information between multiple patientlocations and the telemedicine providers. Shown in the figure are 3hospitals 1, 2 and 3 with a hospitalized patient in each location. RN 1,2, and 3 refer to the local medical care providers for each patient. Asshown in FIG. 10, messages may be sent in response to a clinicalsituation and are broadcast to multiple available medical providers indifferent geographic locations (represented by MD 3 in Kanas, MD 2 inSeattle, and MD 3 in Florida). Any of these remote providers who areonline may respond to the situation and create an actionable order whichis routed back to the originating patient. The remote providers may haveaccess to patient data, which is transmitted via the system 1304, whichmay be a server. In some embodiments, the transmission may be in realtime.

Referring now to FIG. 12, a process 1200 undertaken by the remotemedical provider after the log in is shown. Each box in the figurerepresents a subsequent step in the workflow for a provider. FIG. 12represents the workflow schema, while the FIGS. 6 and 8 show the stateof the system during the workflow. These steps are described in detailin association with relevant figures below.

In some embodiments, an association between a remote provider and ahospital is created on the back end by matching providers to hospitalsbased on licensing and credentialing at sites. Alternatively, in somecases, remote providers can self-select hospitals by creatingassociations with one or more hospitals. As an example, after login, aprovider can add themselves via the Settings element 604 in FIG. 6 toteams and hospitals that they are affiliated with. The authenticationwith the hospital to validate the provider as an authorized caregivermay happen in the background via a 2-step process. The provider mayreceive an email link from the hospital using their standard practice.The provider can then add himself to the hospital that is part of thenetwork of hospitals deploying the system. At that time, anotherauthentication process may be initiated after which a provider may bepermitted to use the system via a login process on the device 100. Uponsuccessful login, the provider may be presented with a dashboard asshown in FIG. 6 that shows a complete list of patient related messages606, broadcast by nurses, as described earlier, regarding the patientsthat are admitted to a hospital unit that the provider is affiliatedwith. In some embodiments, the provider may fill in a questionnaire togenerate a doctor profile, and the questionnaire may include questionssuch as specifies, length of practice, etc. In some embodiments, once aprovider is successfully added to the respondent list, the system mayautomatically populate a doctor profile using information from internaldatabase. The provider can set their status 1202 as Available or Offlinevia the tab 608, shown in FIG. 6. Providers who have set their availablestatus to Available can receive audio-video calls.

Further, a provider can scan through all the messages 606 (messages inthis context refer to consults or requests for consult) and choose theone they want to act on by accepting the message in operation 1204 ofprocess 1200, as shown in FIG. 12. Once a message or request for consulthas been self-marked as “Accepted” it is the responsibility of thatprovider to act on that message or consult. The provider can then clickon the patient's name in the message detail which will direct him to thepatient specific dashboard, as shown in FIG. 8.

Further actions can include an audio-video call 1206 to another provideror bedside nurse by clicking on the video icon 816, as shown in FIG. 8.Once a video call is initiated, the doctor may view the patient using acamera on a client node (e.g., a mobile device), see FIG. 9.Additionally, the provider can view clinical data 814 shown in the rightpane in FIG. 8.

Once the provider has completed their assessment of the patient, theycan write an Order (e.g., medications, lab tests) for that patient (FIG.7) or a Note (FIG. 7) that documents the provider's recommendations orobservations. Orders and notes may be transmitted through secureback-end system 1304 to the patient's permanent health records. In somecases, after the remote healthcare provider supports and advises thebedside user or clinician as needed, and both parties are satisfied thatpatient issues have been resolved, the remote healthcare provider maycomplete a summary note with an assessment and plan for the consultation(FIG. 30). The consult will then be marked as complete and automaticallyremoved from the remote healthcare provider's “active” queue to the“complete” queue. The summary note and all exchanged information fromthe completed consult can be accessed later as needed and is alsoexported, for example as a PDF, for the hospital to upload into theirEMR.

In some embodiments, the platforms, systems, methods, and softwaredisclosed herein comprise a family communications feature allowingreal-time communication with one or more third parties such as family orfriends. As an example, one or more family members can be added to avirtual team (e.g., team of remote providers providing consult for apatient) to allow them to participate in real-time in the care plandiscussions. This is especially relevant in the COVID-19 era in whichthe patient may be quarantined and outside contact prohibited due torisk of infection. In some embodiments, the local or bedside clinician(i.e., at the client node) can facilitate such communications by sendinga text message or email to the family member with a link to join theconversation with the remote provider team.

In operation 1208 of the process 1200, the provider may complete amessage as having been acted on via the completed element 610, see FIG.6. Once a message is completed, it may be removed from the interfacesuch that it is no longer be visible on the user interface for theremote or local provider. However, such messages may be archived andretrieved.

This method of authentication, logging into a system, assigning self toteams or patients, interacting with team members on behalf of patientsvia messages, orders, notes, and audio-video calls, can be extended toany hospital system or groups of healthcare providers in any part of theworld.

The advantages of the present disclosure may include, for example, theubiquitous ability for healthcare providers to communicate with eachother using mobile devices in order to care for any number ofhospitalized patients across any number of hospitals in any part of theworld. The rich and intuitive user interface allows for streamlinedcommunications that enable efficient and effective patient care inhospital units with the least possibility of errors and clearly auditedactions. The use of an integrated software platform that allowscommunication through messaging, audio-video calls, Orders and Notes,access to patient data securely, from anywhere, anytime on any mobiledevice, represents a significant advantage and advancement in thisfield.

In one embodiment, the present disclosure is an effective and economicalway to match the limited supply of healthcare providers to theinordinate and growing needs of hospitalized patients all over theworld. The use of mobile technology along with unique, intuitive anddetailed design and organizational features allows the system to be usedacross multiple settings in healthcare.

Details of Communication

Communications between local (e.g., nurses) and other remote providers,namely other nurses, physician's assistants, and doctors, may be in theform of messages, audio-video calls, orders, and notes. Messages are abroadcast entity that are initiated by local providers and generated inresponse to a patient need. They may be composed in real-time using thesystem and flagged by urgency level which allows remote providers toprioritize their responses. The system may transmit these messages inreal-time so they can be viewed by any provider who is simultaneouslylogged into the application. In some embodiments, messages may betransmitted inside the application/platform. Alternatively, or incombination, messages may be transmitted outside theapplication/platform environment (e.g., using native text messagingsoftware of the user device). Messages may be formatted to includeattachments (e.g., photos, pdfs, etc.). Audio-video calls may betargeted entities and may be initiated by one person to anotherindividual or a group of providers. Often, nurses or other localproviders may initiate an audio-video call to communicate directly witha provider to provide further clarity on a situation. The system may usean integrated audio-video system that allows such communicationssimultaneously. Alternatively, or in combination, the system mayfacilitate calls using the native calling features of the user deviceand/or enable calls from the system to a telephone number, or otherexternal system. Orders may be written by remote providers, such asdoctors or Physician's Assistants, and can be processed by localproviders such as nurses. Orders typically consist of specificinstructions to nurses in response to the patient condition as describedby the nurse in the message described above. Orders may be processed bythe nurses and sent into the hospital medical record to officiallyrecord and document the same. Notes may document comments that a doctoror a physician's assistant may wish to add about the patient.Beneficially, these notes may be sent electronically to the hospitalmedical record to have a clear record of all patient related activity.The messages, orders, and notes may be created with a patient name,location, and identification code by the system. Further, allcommunication may be tagged with time-stamps to enable any user to havea clear chronology of all activity.

In some embodiments, communications between providers and/or patientsmay be exportable (e.g., from the app or from an archive thereof). Insome embodiments, communications, such as chat communications includingphotos, text, etc., may be exportable as a PDF. Exporting communicationsfrom the app may facilitate record retention and documentation duringconsultative care, and may make such communications easily incorporableinto the patient's EMR.

The systems and methods described herein may provide a more efficientand intuitive Tele Critical Care experience. The system may beconfigured for synchronous provider to provider (and patient toprovider) communication via secure messaging and integrated multi-partyaudio and video conferencing to enable seamless collaboration andcoordination of care on one platform. The system may also facilitateefficient triage based on message levels of urgency and visual cues ofacuity, and an SOS feature for emergent situations that require animmediate response. Remote professionals may view messages acrossmultiple sites simultaneously and respond in real-time based on urgencyand acuity.

The systems and methods described herein may be agnostic to the deviceof the user. In some embodiments, the system may be accessible to userson Android devices, iOS devices, or other mobile operating systems.Alternatively, or in combination, the system may be accessible todesktop system running operating systems such as Microsoft Windows,macOS, Linux, or the like.

FIG. 14 shows a high-level overview of a telemedicine system. The systemmay comprise a cloud-based distributed platform. The system may beconfigured to connect self-registering patients, bedside providers, andcritical care team remote experts and/or provide administrative, triage,and/or data collection oversight functions. The telemedicine app mayprovide synchronous (voice/video) and asynchronous (text, photo, PDF)communication between mobile devices (e.g., Android and iOS phone andtablet). The app may be downloaded from the respective device's digitalstore and may provide self-registration for a patient, a local providercaring for the patients, a remote provider caring for a patient, and/ora remote critical care team expert.

In an exemplary scenario, a local viral outbreak (such as COVID-19)cluster may occur in a senior living facility. Bedside providers mayaccess the telemedicine system and register the location as describedherein in order to recruit remote providers for help. Remote providersmay be called on to help triage the patients as described herein (e.g.,via tele-consuls). Some patients may be transferred to the localhospital for treatment while other patients may remain in the seniorliving facility for care. Bedside providers at the senior livingfacility may access the telemedicine system to facilitate patient care.In the event that the bedside provider is unfamiliar with the virus,treatment protocols, and/or necessary equipment, training resources maybe accessed in the telemedicine app to aid in bringing them up to speed.Teams of bedside and remote providers may be assigned by thetelemedicine system as described herein. Patients may be handed offbetween providers as described herein. Patient vitals, sensor data, etc.may be monitored by the telemedicine system as described herein. Thesystem may be configured to facilitate care even when externalcommunication systems (e.g., internet, telephone, etc.) are down. Thetelemedicine system may be configured to enable real-time communicationsbetween team members in a patient-centric manner. Data may be collectedfor immediate use (e.g., patient care, remote monitoring by thetelemedicine system and/or regional and national authorities) and forlater use (e.g., analytics, etc.) as described herein.

Distributed Architecture

FIG. 15 shows a schematic drawing of a system for telemedicine includinga distributed architecture. A distributed architecture may be beneficialin that it does not require a large infrastructure and, when needed(e.g., during an emergency), can be created in an ad hoc manner,optionally utilizing highly configurable Internet of Things (IoT)technologies (e.g., for interfacing with medical devices to enabletelemonitoring, etc.). The system (e.g., platform and application) mayprovide a virtual command center role that ensures validation, control,and/or supervision of the response to healthcare support and/or distresscalls. Bedside providers and/or first responders may download the apponto smartphone. Bedside providers, first responders, and/or patientproxy (family member for example) can create accounts instantaneouslyand securely through authentication. The system may provide access to avirtual network of critical care experts using a real-time, dynamicrecruiting process. All consults may be visible to the network ofspecialists and any available specialist may address the request.Alternatively or additionally, only a portion of the remote healthcareproviders may be notified with a consult based on the nature of theconsult and the specifies associated with the providers (e.g., whenthere are plenty of healthcare providers are available at a moment). TheS.O.S. Feature can notify all available experts simultaneously in anemergency. As medical demand surges, the system may geo-strategically,and incrementally, notify critical care professionals in real-time toprovide on-demand care. The system may simultaneously match patients inreal-time, using an algorithm based on estimated medical demand, andfacilitate dynamic staffing ratios based using artificial intelligence(AI)-based recommended guidelines. Patients who cannot receive timelycare by a physician may be transferred to a different provider in thenetwork. Some or all communications within system interface can beuploaded to a hospitals system's EHR through a fast healthcareinteroperability resources (FHIR) interface and thus function as amobile EHR (electronic health record). Care transitions (shiftmanagement and handoffs) and patient transports may be managed throughthe platform as described herein.

The system may be modular and allow for parts of the systemfunctionality to be added and removed as needed. Therefore, the initialcapabilities of this system may be rapidly deployable applications, butthe system may also have the capabilities to integrate medical devicedata both directly through the app for some simple sensors or throughthe medical internet of things (mIoT) platform for more robust datafeeds.

FIG. 16 shows a schematic drawing of the cloud and near patientcomponents of a telemedicine system. This diagram shows the integrationthat may enable data from the remote and near patient providers to allbe aggregated in a common data repository, while feeding the local,national, and regional dashboards. The telemedicine platform may behosted via cloud-based services (e.g., Google-cloud) which may enablequick approval from federal regulators and/or leverage various big dataand AI tools.

FIG. 17 shows a schematic drawing of a virtual data space connectingvarious components of the telemedicine system. The foundational datainfrastructure may enable data from the bedside to be made available tomultiple telemedicine (or “tele-critical care”) solutions via datadistribution through a user's application and a web portalsimultaneously for multiple patients. In some embodiments, thisinfrastructure may enable medical devices from multiple vendors to beintegrated simultaneously into the tele-critical care solutions and tosituational awareness dashboards simultaneously in near real-time.

The cloud coordinator may enable scalable distribution of data which mayenable more flexibility for modular lightweight easily scalabletele-critical care solutions. The cloud coordinator data containers maybe categorized in two types. The information and data containers.Information containers may contain predefined and fixed informationwhich may provide the initial starting point to identify data sessions.Data containers may contain streams of specific data sessions for thepatient. These data containers may be orchestrated by the webserver tocreate virtual data sessions, where a virtual ward can be created bycombining various data containers. This mechanism may also create a setof situational awareness data containers that would be free ofpersonally identifiable information (PII) or transform the data if realtime data is required for situational awareness applications. As thesystem scales, there more and more data containers for both informationand data may be added. It could be imagined that each site has aninformation data container and the corresponding data containers.Therefore, scaling may come down to expanding the amount of servers inthe cloud services, but the flexibility is still available.

As the tele-critical applications form virtual wards, one or more datacontainers may be dynamically spun up which will represent the patientsin this ward. This may enable the tele-critical care applications toonly receive the data that they need. Each virtual ward may also createa software defined network protecting the privacy of the patients. Aspatients move from ward to ward, they may be made available in thenecessary data containers. This containerization of the data may alsoallow the system to transform the data for the situational awareness andoperational dashboards without spending PII to these dashboards and makethe transmission of data even in limited data settings easier.

FIG. 18 shows a schematic drawing of a cloud coordinator's capabilities.The near patient environment can be as simple as a mobile app whichenables video, audio, messaging, to the integration of sensors whichcommunicate via the applications and finally the instantiation of anintegrated clinical environment around the patient. The integratedclinical environment may enable the implementation of apps which cancommunicate with medical devices that are software or hardware which arenecessary for the future tasks. In some embodiments, the Command CenterDashboard may be driven by data collected from the mobile applications.In some embodiments, data may be integrated from the integrated clinicalenvironments to provide a robust set of situational awareness data asdescribed herein.

Virtual Command Center for Monitoring System Clinical Performance andEfficiency

FIG. 19 shows a schematic drawing of a virtual command center. Thesystem may include a medical interne of things (mIoT) infrastructurethat enables the ability for real-time data collection from eachbedside. This infrastructure, which may optionally follow an IntegratedClinical Environment Architecture standard (AAMI 2700), may enable forboth real-time data but also the capabilities to aggregate medicaldevice data as well as clinical transactions. The platform also mayallow for applications to be hosted in a distributed way while enablingdata to be available in the cloud. This may enable a highly modularflexible system and enables an interoperable multi-vendor solution. Thisrobust data infrastructure may enable a Virtual Command Center (VCC),which is a web-based command and control center facilitating thefunctions of triage, oversight, staffing, real time data collection andanalysis.

FIG. 20 shows a schematic drawing of physical components of atelemedicine system. FIG. 20 shows the physical layout of the cloud anddistributed ICE architecture.

FIG. 21 shows a view of a user interface for a command center dashboard.The system may include hierarchical levels of administrative and datafunctionality. In some embodiments, there may be threelevels—Local/Facility, Regional, and National. Level relevant data maybe selected to populate dashboards facilitating level appropriatesituational awareness. For instance, individual device data (e.g., modelof ventilator) may be collected at the end user level and may be visibleat a regional and national level to assist in the distribution ofequipment and logistical support. Patient acuity may be visible at thelocal level down to the granularity of individual vital signs tofacilitate individual patient care. At the regional level, this data maybe summarized with acuity scores to identify hot spots and assist withrecruiting critical care staff and ensuring the system is fully capable.This patient level data may be further summarized into incidence,prevalence, and mortality rate at the national level for situationalawareness.

In some embodiments, an administrator at the regional level may look upan aggregated numbers (e.g., number of requested consults, number ofin-hospital patients, number of medical devices in use, number ofavailable healthcare providers, etc.) at individual sub region orhospital. In some embodiments, an administrator may request to viewpatient-level data, such as vital signs, lab results, etc. As describedelsewhere herein, the telemedicine platform may store patient data atthe patient level in the database, and aggregate patient data fordisplay. In some embodiments, the aggregation is performed in real-timeor near real-time, i.e., when there is available new data, the platformperforms an aggregation in respond to receiving this new data. When thenumber of participating hospitals increases, aggregation of data becomesa time-consuming task for the platform, and may slow down the platform.To overcome this, in some embodiments, the aggregation may be set tohappen periodically, e.g., every 30 minutes, 20 minutes, 10 minutes, 5minutes, one hours, two hours, three hours, etc. The aggregated valuemay be displayed with a timestamp of the aggregation next to it. In someembodiments, the user may have an option to force the platform toperform a real-time data aggregation, e.g., by refreshing a webpage ormobile app page. This may allow a user to pull the latest aggregateddata by perform a real-time or near-real time aggregation. Thismechanism may ensure the users access to the latest data, but if thereare no users requesting the latest data, then the system aggregates datain a periodically manner to save bandwidth.

FIG. 21 shows an exemplary dashboard for a Virtual Command Center. Thevirtual command center may be a web-based dashboard style portal, whichmay be configured to receive and display data in real-time from allpatients, bedside providers, and/or remote providers. There may beseveral distinct types of users of the Virtual Command Center (VCC):clinical administrators (e.g., director(s) of clinical operations atlocal/regional/national levels), administrators responsible for resourceand infrastructure management, and technology (IT) professionals. TheVCC data display may be organized into 4 major domains: PatientOrganization, Staffing, Clinical Operational Metrics, and ResourceUtilization.

Patient Organization: The Patient organization domain may displayreal-time information about pending and active consults. Thisinformation may include geographical location (e.g., national, regional,state, hospital/ward), and/or patient census for those tiers oflocation. Patient data can be scaled and sorted by location (multipletiers), acuity, urgency of the call, and elapsed time since posting ofconsult. Users may find this view particularly useful to quicklyidentify the magnitude and location of a disaster situation, withfurther fine-tuning of the information based on sorting functions.

Data may also be displayed according to a list of all Virtual Wards. Foreach Virtual Ward, individual patient information may be provided,including acuity and geographic distribution (e.g., a virtual ward maybe one place, or may be a distributed set of locations). Virtual Wardscan be grouped together based on teams or providers assigned to care forthem.

Staffing: The Staffing section may display information on individualremote professionals, their availability, and workload measured by thenumber of active consults. The team section may show the teams. For eachteam, all members of this group (intensivists, advanced practitioners,nurses, pharmacists, respiratory therapist) may be listed. Also, theirworkload, as measured by the number of active consults, may be shown.Both Staffing and Teams views may allow the director to see in real-timethe availability of remote professionals and provides insights on howmuch the system is stressed by comparing the workloads of individualremote professionals and the virtual teams.

Clinical Operational Metrics: The Clinical Operational Metrics domainmay allow direct feedback on important parameters relevant to patientand provider interactions. Examples of operation metrics includeinformation on average response times (e.g., to identify lags andpotential areas of system stress), healthcare providers capacities, andtime trends of patient volume moving through the system (e.g., to allowidentification of past and emerging trends). In some embodiments, thepatient and consultation volume may be provided and analyzed, i.e., bylocation.

Resource Utilization: Along with the data related to system resourcesthat are captured in the Resource Utilization domain, this informationmay be vital to optimizing system performance. Additionally, nearreal-time analytics powered by tools such as Tableau may allow furtherin-depth analysis to be performed to gain insights and make decisionswith regards to load balancing, team assignments, and resourceallocation. In some embodiments, the system recognizes that the remotehealthcare provider has an active consultation, but will not preventthem from accepting the additional consultation request. In some cases,the system comprises a load balancing feature that helps ensure noremote healthcare provider becomes overwhelmed with multipleconsultations (for example, preventing acceptance of requests forconsults that are estimated to exceed the response duration or timelinecorresponding to the urgency of the consultations). When multiple remotehealthcare providers are active (“on call”) for a given hospital or setof hospitals, they may be given different roles such as primary andsecondary or backup. In some embodiments, the system utilizes one ormore rules to determine when to route a new inquiry to a given remotehealthcare provider depending on their role, for example, between aprimary and a backup provider. In some embodiments, the system uses abuilt-in load balancing strategy to ensure that no provider isoverwhelmed with consults. Load balancing can establish a maximum numberof routine or urgent consults that any one remote healthcare provider orteam can accept, and then routes consults to a back-up provider or team.The provider can use clinical judgement to deviate from this assignment;however, it is intended to assist in creating a balanced workload. Insome cases, the system defers to the autonomy of the primary if there isno backup or secondary provider available. Accordingly, using theurgency flags, aging times, and their own professional judgement, theremote provider can attend to each consult as they see fit based onneed, urgency, and complexity. In some cases, much of the communicationbetween the remote provider and the bedside clinician can be achievedthrough asynchronous messaging, allowing the intensivist to efficientlysupport multiple consults simultaneously.

FIG. 22 shows a view of a user interface for an administrator portalhospital management tool. FIG. 23 shows a view of a user interface foran administrator portal hospital management tool with manual locationentry pop-up window open. FIG. 24 shows a view of a user interface foran administrator portal provider management tool. The system may includean administrator portal. The administrator portal may be separate fromor a part of the VCC. There are two main roles in the admin portal. Oneis a triage professional role who triages the self-registered patientfrom home location and assigns those patients to home providers (localcare providers) who will then communicate with the self-registeredpatient through chat, audio and video calls using the app and alsoescalate to any virtual intensivist team. The second role is of an adminwho can perform the following functions: a) onboarding a hospital oradding a new field hospital/site to the system; b) validating andapproving the credentials of all providers (remote providers as well aslocal care providers) who signed up in the app; and c) broadcasting asystem wide message (e.g., system alerts to all users of the app). Ahospital, field hospital, or a virtual hospital can be added inreal-time using the admin portal (e.g., as shown in FIG. 23) and may beavailable instantaneously for the users of the mobile app. In someembodiments, the admin portal may enable a user to manually addhospitals, providers, and/or patients. In some embodiments, hospitals,providers, and/or patients may be automatically reviewed and added tothe system without administrator intervention. In some embodiments, theadmin portal can be used to broadcast a system wide message/alerts toall users of the mobile app.

In some embodiments, the admin portal may facilitate one or more of auser groups function. The user groups function may ensure proper consultrouting to the credentialed group of remote healthcare providers and/ormaintain data access (e.g., patient medical information) within thecredentialed group. The onboarding process for hospitals may use thesame system and portals as shown in FIG. 23. The data is separated basedon the credentials associated with the user group associated withindividual hospitals. In some embodiments, the healthcare providers withthe appropriate credentials in a hospital may have access to thepatient's health record, whereas the healthcare providers who lack thecredentials may not have access to the patient's health record. In someembodiments, a healthcare provider may not automatically have access tothe patient's health record by virtual of affiliation with acredentialed hospital; the hospital may grant credentials to aparticular healthcare provider by adding this provider to the user groupof this hospital. After that, the remote healthcare provider may haveaccess to view the patient's record. In an event of disaster whenmultiple hospitals may be quickly deployed and act, this user groupsfunction can beneficially create an omnibus user group wherein allavailable hospitals may be onboard quickly. This allows all hospitals onthe platform to have access to all the patients in need of healthcarewithout having to go through multiple layers of authentication process.In some embodiments, in a normal deployment of onboarding a hospitaluser group, this credential mechanism may aid safeguarding access topatient's health record and limit access to the credentialed user group.In this scenario, when a bedside provider requests, e.g., via the appassociated with the telemedicine platform, a consult for patient A, thesystem may look up a list of hospital user groups and identify the usergroup (e.g., the group of remote clinicians) the bedside provider isassociated with. Once the user group is identified, the system may pullout a list of all (or mostly all) currently-available remote healthcareproviders and apply a filter on the list to generate a resulting set ofproviders. The filter may be pre-defined or customized as needed.Therefore, the generated-resulting set of providers are the group ofhealthcare providers who has access to that identified hospital usergroup alone, this may reduce the risk of patient health recordingleaking and improve the performance of the system by reducing overhead.

The multiple roles (patient, bedside provider, remote provider, and VCCadministrator), their self-registration workflows, and their initialviews and functions, are described in greater detail below.

Self-Registering Patient

The system may include a patient self-registration portal which allows aperson who is not in a healthcare facility and who doesn't have anotherperson caring for them (e.g., layperson, or trained caregiver) toinitiate contact with the system via the app. The patient may be askedto provide name, date of birth, gender, and/or a phone number. Theseitems may be collected to have sufficient data to generate an enduringunique patient identifier. The phone number may allow for contact to bemade asynchronously from the system as described herein. The patient mayalso enter a description of their situation, a question or issue, and/orsome reason why they are accessing the telemedicine system. Theinformation from the self-registration, including contact info and thesituation/issue, may be populated real-time into a triage role viewinside the admin portal. The patient may be presented with a chat windowwhere the system may prompt them to upload their ID and insuranceinformation and/or display a message that consultation is pending. Insome embodiments, the patient may be asked to enter a zip code, or themobile device GPS data may be accessed, in order to gather data ongeographic distribution of patients. The triage role may then assign ahome provider to that patient, who may then start discussing thesituation with either patient or a family member who is supporting thepatient. The home provider may be able to send a message, initiate avideo or an audio call using the app or if the patient is not availableon the app, they can use the phone number to asynchronously contact thepatient. There may initially be no direct communication between apatient and the expert remote providers, without triage performed at thevirtual command center, based on the nature of the chief complaintentered into the form. In some embodiments, triage may be performed by auser (e.g., physician or other Home Provider) accessing the virtualcommand center. Alternatively, or in combination, triage may beautomatically performed by the system. The self-registration feature mayoffer the advantage of earlier access to care for patients who mayotherwise not have access to specialists. Additionally, theself-registration functionality may serve as another valuable mechanismto alert the system and relevant partners (e.g., governmental agencies,hospitals, etc.) about emerging disasters as early as possible.

Home Bedside Provider

The “Home Provider” role may connect with patients by signing up to theApp as Home Provider and can then communicate with patients and/or addthese patients to the message board as required. That way, the care canbe escalated by the “Home Provider” to any virtual intensivist team.This approach of “contact and triage” may mitigate the risk of the“worried well” overwhelming the system with non-urgent consults (awell-known phenomenon in triage, disaster response, and telemedicine).

Bedside Provider

In the event a provider engaging in patient care wishes to request aconsult, they too may self-register for an account in the app followingdownload. The self-registration process for a provider may request name,email, phone number, and, if “bedside provider” is selected, a hospitallocation, home location in the scenario of an in-house nurse, or afacility location in the scenario of a senior living facility or nursinghouse may be entered. The hospital location may be one of severalpre-populated hospital choices or a “virtual ward” if the care is beingprovided outside of a hospital (e.g., at a clinic, gymnasium, patienthome, etc.). A password may be chosen by the provider, and an end userlicense agreement may be presented with the option to select. Once inthe system, the bedside provider may be presented with two actionoptions: 1) Access the on-call directory, or 2) Register a patient tocreate a consult. Accessing the On-call directory may give the bedsideprovider the opportunity to call a provider directly for anurgent/emergent question, and or to pass information vertically up thesystem. If the provider chooses to register a patient/create a consult,they can input the patient's name, date of birth, and gender. They maythen be given the option to manually input some patient information.Exemplary patient information may include supplemental oxygen and levelof consciousness in a non-limiting example. The specific data fields maybe programmable and able to be specified in order to adapt to differentdisasters. Supplemental oxygen and level of consciousness were chosenfor an exemplary COVID19 telemedicine system embodiment because, alongwith vital signs (HR, BP, Sats, RR, temp), they allow the calculation ofa National Early Warning Score (NEWS Score) for triage and acuityranking as a demonstration of COVID19 data flow. To further facilitatetriage, and mark acuity, the consult may be marked “urgent” at thispoint if needed. Next, if the provider has access to a physiologymonitor that has been integrated into system's device ecosystem, it maybe linked within the app to the patient at this time. Finally, the chiefcomplaint/consult information may be free texted into the system and theconsult request may be submitted. The consult request may then bedisplayed in the active consults section of the user interface. On theconsult screen, patient vital signs data may be viewed, and based on thesystem's acuity algorithm, each patient may be intuitively color-codedto indicate urgency (e.g., red/yellow/green) based on their physiologydata (which may be manually and/or automatically entered as describedherein). Patients can be searched and filtered by “active” consults(i.e., those accepted by a remote provider) and “pending” consults(i.e., those awaiting acceptance by a remote provider). If the activeconsult is selected, the provider may enter the consult chat screen, inwhich asynchronous communications (text, photo, document) may beuploaded to the consult, or, once the consult is accepted by a remoteprovider, synchronous (voice and video) communications can be utilized.Once the consult is accepted by a remote provider, they may communicatesynchronously or asynchronously as indicated. The system may also beconfigured to generate an SOS call to any available online provider ifthere is a delay in response by the designated provider. This SOSfeature may alert every available provider online in the system and maycontinue until answered.

The telemedicine platform may provide qSOFA implementation in itssystem. A qSOFA score is calculated based on the patient intake formfilled by the patient or by a bedside care provider. The parameters forthe qSOFA score calculation may include the following: First, a GlasgowComa Scale/Score (GCS), which is calculated by asking i) best eyeresponse, if spontaneously, then GCS=4, if respond to verbal command,then GCS=3, if the patient responds to pain, the GCS=2, if there is noeye opening, then GCS=0 (not testable=NT; ii) Best verbal response: iforiented, then GCS=5, if confused, then GCS=4, if inappropriate wordsare spotted, then GCS=3, if patient responds with incomprehensiblesounds, then GCS=2, is there is no verbal response, then GCS=1, if it isnot testable/intubated, then GCS=0; iii) best motor response: if patientobeys commands, then GCS=6, if localizes pain, then GCS=5, if withdrawalfrom pain, then GCS=4, is flexion to pain, then GCS=3, if extension topain, then GCS=2, if there is no motor response, then GCS=1, if nottestable, then GCS=0. Combining all the GCS scores from the above threequestions, the system may generate a total GCS score. If the total GCSscore is greater than a predetermined threshold, e.g., 15, then add 1 tothe qSOFA score, if not, then add 0 (not change) the qSOFA score.

Second, the bedside provider may evaluate respiratory rate, and if therespiratory rate is above 22, then add 1 to the qSOFA score, otherwise,add 0 to the qSOFA score. Third, if the systolic BP is lower than 100,then add 1 to the qSOFA score, otherwise, add 0 to the qSOFA score. Ifthe resulting qSOFA score is lower than a pre-determined threshold,e.g., 2, then the patient is not in high risk for in-hospital mortality;if the resulting qSOFA score is equal to or greater than apre-determined threshold, e.g., 2, then the patient is in high-risk forin-hospital mortality. The above specific criteria, questions, andscores are only presented as examples; one may implement other criteriato generate an acuity score. The qSOFA score may be displayed next topatient information to help the remote care provider to assess theacuity and/or risk of a patient.

Remote Provider

In support of the system, existing providers may log in (provided theyalready have an account) from the front screen. Additionally, newproviders may register for an account. New providers may be prompted toenter their name, phone number, email address, and if selecting “remoteprovider” to provide consultative/expert care, they may be prompted toenter an NPI number. This may be an optional entry or a required entry.Once logged into the system, the remote provider may be able to see alist of pending (i.e., not accepted) and active consults (i.e., thoseaccepted by a provider). This list may be color coded (e.g.,red/yellow/green) by acuity as described herein, and marked urgent.These consults can be expanded to show the vital signs data, and/orselected to open up the chat screen for the consult. If the consult isactive (meaning the provider has accepted the consult) the chat screenmay display upon expanding the patient, and may allow asynchronouscommunications (text, photo, document), or synchronous communications(voice, video). The remote provider can interact with the bedsideprovider or a patient, and once the consultation is finished, can select“complete consultation”. At that time an “assessment and plan” templatedchat may appear, allowing a final documentation of the diagnosis and theplan communicated to address it.

Patient Transfers

A local care provider (e.g., a bedside provider or a home provider) cantransfer a patient from one ward to another within the hospital (e.g.,COVID Ward to COVID ICU) as well as from a site (home or any fieldhospital) to a hospital while maintaining using the app and telemedicineplatform. Once the physical transfer is initiated and done, the detailsmay be posted against the patient in the message board. Additionally,the current location of the patient may be clearly marked in the patientdetails in the app. The remote provider who is providing care may beable to view this information and be informed of the patient's physicalmovement. The remote healthcare provider may also be able to view themedical devices and/or lab capacities that are available in thishospital location, and provide orders or other patient care instructionsaccordingly. If a local IoT platform is available but there is no accessto the internet, but local intranet access is available, then with thesystem platform data can be transferred from one bedside system toanother. This may allow for a robust set of data to be made availableinstantaneously at the patient beside at the time of transfer, largelyindependent of internet access.

Provider Handoffs

In some embodiments, there may be at one or more kinds of providerhandoffs available in the app. In some embodiments, a handoff may occurwhen a local care provider (e.g., a bedside provider and/or homeprovider) hands off all of their consults to another local care providerat the end of their shift. Once the handoff is completed, the messageboard for the patient may be updated with the current local provider sothat the remote provider can continue providing care without anydisruption. Alternatively, or in combination, a handoff may occur when aremote provider hands off the patient virtually to another remoteprovider. In this case, a first remote provider may initiate a virtualhandoff using the app. The other remote providers who are available mayreceive a notification of the consult at which they can act on andaccept the consult. Every handoff may be accompanied by a handoffsummary note for the next provider to read on the procedures and actionsperformed by the previous remote provider.

Remote Provider Teams

When a Remote Provider accepts his first consult, a new team may becreated automatically by the system. For example, Team Alpha. The systemmay generate teams based on built-in, user-generated, orautomatically-generated (e.g., via machine learning) staffing ratios.Staffing ratios may vary depending on the different roles created in thesystem for remote providers These ratios can be altered based on thereal use cases. In an exemplary embodiment, when a Team is created, thesystem may look at the other Remote Provider types and assign them tothe Team Alpha by using the following rules:

Doctor of Medicine (MD)/Doctor of Osteopathic Medicine (DO)—can be partof only one team.

Advanced Practice Provider (APP)—can be auto assigned up to 3 teams.

Registered Nurse (RN)—can be auto assigned up to 5 teams.

Respiratory Therapist (RT)—can be auto assigned up to 6 teams

Registered Pharmacist (RPh)—can be auto assigned up to 6 teams

In some embodiments, when a consult is accepted by a MD/DO, a remotecare team is automatically formed by the system based on theavailability of other remote providers (APP, RN, RT and RPh). In someembodiments, the MD/DO may preselect a group of other remote providers(APP, RN, RT and RPh) based on some pre-defined criteria. For example,the MD/DO may designate a group of remote providers (APP, RN, RT andRPh) as the favorable group for a patient who has respiratoryconditions, based on his past experience working with the team or basedon the remote providers' specialties. Team Alpha can be associated withmultiple patients. The system may give the flexibility of configuringthe quota of consults a team can take at a given time.

Clinical Training Materials

In some embodiments, the clinical training materials may be hosted as astatic website, which may be readily available and accessible inside theapp by local care providers as well as remote providers. In someembodiments, the clinical training materials may be downloaded from aserver onto a user's device and stored locally to allow for offlineaccess.

In some embodiments, the system may comprise a comprehensive library ofdevice specific proprietary data communications interfaces of allpotential devices that might be deployed in disaster situations. Toimprove device interoperability, the system may also include a standardmedical device information model and controlled vocabulary based oncurrent international standards to assist with ensuring rapidintegration during disaster scenarios.

Open Patient Data API

The system's Cloud Coordinator may implement an open API, which mayallow for data to be organized so Virtual Wards can be created. Thecloud coordinator may also have the ability for data containers to becreated for situational awareness data modules as described herein. Thisrobust API may contain multiple functions including the ability toorganize real-time streaming patient data in a way the telemedicine appcan consume data in an organized way around the virtual wards. This mayinclude the physical location of the patient.

Master Patient Index

The system's cloud coordinator may implement an electronic masterpatient index. This master patient index may allow for a list ofpatients and their current and historical resources to be leveraged inthe system. The master patient index may also generate unique patientidentification for the system and may have the ability to implementpatient matching rules in the system.

Data repository

The system's cloud may implement a big data storage capability inconjunction with the cloud coordinator. The data repository mayaggregate and store data coming from both the connected devices and thetelemedicine applications. Data may be integrated with the local,regional, and national dashboards. Historical data may be made availableto the telemedicine applications via the cloud data repository. Thisdata repository may be configured to copy database tables to otherdatabases such as the commons data repository utilizing standard opentools available in the Hadoop Data File System (HDFS). HDFS views canalso be setup for operational dashboards in order to leverage the powerof large data sets for near- or real time analytics. The data analyticscan be displayed via the virtual command center dashboard such as shownon FIG. 33.

Interoperability

The Open Patient Data API, Master Patient Index, and Data repository maybe based on open standards, a robust data dictionary as describedherein, and may be key elements which allow data to be not onlyaggregated for research but also allows for telemedicine systems tointeroperate at least in the ability to share data. For example, when apatient is associated with multiple sites with multiple vendors as partof the system, the patient's previous data, may be available to both thelocal and remote care provider leveraging this least common denominatordata set.

Time Tracking

In some embodiments, the system may include an automatic time trackingcomponent for critical care billing. In some embodiments, rather thanclosing a consult when it has been deemed completed, the consults may beleft open for a period of time (or indefinitely) to enable the care teamto go back to the patient data as needed. For example, if consults couldbe left open, or at least for a period of time knowing that particularbedside provider and the consulting critical care clinician will both beavailable for a specified period of time, it may make the most sense forany additional issues with that patient to be addressed by the samecritical care consultant. With that in mind and considering criticalcare is billed based on the initial encounter of 30-74 minutes (99291)followed by additional 30-minute blocks of time (99292), having the appautomatically track actual time spent in the consult may be extremelyhelpful from a billing/administrative perspective.

Staffing and Workload Models

The systems and methods described herein may create a virtual network ofmulti-professional critical care experts through real-time, dynamicrecruiting using the telemedicine App and available database(s) ofcritical care professionals. A Virtual Command Center (VCC) created onthe system's web portal, and supported by authorized personnel, mayensure critical care provider credentialing and availability, as well aspersonnel and resource control, and oversight of the response to callson the system's network. As demand for critical care support surges, thetelemedicine App may geo-strategically and incrementally recruitscritical care professionals into the available provider pool via thetelemedicine App in real-time, thereby forming an elastic, cloud-basedvirtual care team. The system's network may simultaneously matchproviders and patients to needed critical care resources via thetelemedicine app, with algorithms to estimate medical demands. Thetelemedicine app may further prioritize patient care needs to facilitatedynamic staffing and fluid movement of professionals among care teams tomaintain appropriate staffing ratios and response times in a dynamiccrisis environment. Critical care professionals can thereby be mobilizedto address patient care needs in a flexible, scalable, and dynamicfashion when demand may rapidly outpace supply, and patients can also betransferred between virtual care teams in the network to ensure patientsand bedside providers receive timely support from the remotetelemedicine team. In some embodiments, machine learning algorithms maybe utilized (e.g., developed from the implementation data) facilitatedynamic staffing to match demand.

In some embodiments, staffing may be achieved through a pyramidalstarring model, with a trained or experienced critical care physicianadvising multiple ICU APPs and/or non-ICU physicians, who in turn mayeach interact with multiple team members under them, and so on down tothe patients. This paradigm may ensure that the highest level ofcritical care expertise is provided to the most people. It canrealistically be accomplished through an integrated critical caretelemedicine platform. For example, in an area such as New York Citywhere there was a projected 7000-ICU-bed shortage during COVID-19,non-intensivists may be required to provide complex critical care beyondtheir training and scope of practice. Additionally, they may do so in anenvironment that was not designed for critical care delivery (e.g.,hospital floors, tents, operating rooms, hallways, etc.). Havingon-demand access to nationwide board-certified intensivists with aplethora of experience will undoubtedly improve patient outcomes andimprove bedside provider morale.

Recruitment and Vetting Process

In some embodiments, providers may be recruited through a call forvolunteer request. Providers may be asked to provide their contactinformation, credentials, and expertise of the volunteers, which may beverified through the publicly available NPI system. The provider'scredentials, including specialty and licensure requirements wereverified and the NPI number may be verified and recorded by the system.In some embodiments, the process to recruit, vet and onboard volunteersmay be optimized through automation. Additionally, an automated alertsystem to communicate to providers registered with an account may beused to recruit providers when the need arises. For example, theautomated alert system may be triggered (e.g., by an emergency) and maysend alerts to providers via an external notification system (viatelephone calls, etc.). A virtual command center may be set up and/oraccessed by an authorized user, who may trigger the app to send out anin-app call for volunteers. In some embodiments, this may be doneautomatically. Virtual wards may be set up as described herein andresponding providers may be onboarded, oriented, updated, and sortedinto teams as described herein.

Staffing and Workload Estimates

In some embodiments, a critical care provider may be reasonably expectedto manage 2-4 hours per day of consult time. For an exemplary network ofabout 300 willing, experienced, self-identified, vetted critical careproviders on the staffing roster, approximately 35-50 consultants may beon at any given time. Simulation testing of telemedicine system inprolonged field care scenarios have shown that most tele-critical carescalls in the resource limited/disaster setting range from 5-10 minutefor quick questions, dose/vent adjustments, while some are longer in the25-35-minute range (including new complicated consults, procedurementoring, etc.). If we estimate that each would provide for 3-4consults per hour (i.e., a consult can be managed on average in 15-20minutes), this would allow for 100-200 consults hourly or 2400-4800 perday. This pace may likely be sustainable for the initial 5-10 days of apandemic, disaster or mass casualty event without further recruits,resulting in 12,000-48,000 consults handled in that initial period. Ifthe event were similar in prevalence and severity to the currentCOVID-19 pandemic, approximately 10-20% of affected people would beseverely ill; in COVID-19 approximately 15% of affected persons requireinpatient care, and 5% of the affected require critical care. This meansthat the projected 12,000 to 48,000 consults in the first week (5-10days) could represent the steady state System Load of a similarpandemic/mass casualty even affecting 50,000 to upwards of 960,000people depending on disease severity in the first week. This initialsystem load could be expanded rapidly with additional onboarding asdescribed herein, and may be triggered by data analytics (e.g., as shownin the virtual command center) of real-time consult load, length, typeof providers engaged, and percentage of providers engaged. If the systemis kept at 60-80% utilization, the additional capacity would allowflexibility in the response and time to recruit, vet and onboard newremote providers. The rapid and intuitive usability of the system maylend itself to this rapid scalability and expansion. If a successfulrecruiting call was able to increase the remote provider pool up to 10%,then 60,000-200,000 weekly consults could be handled at steady state. If20% of providers were part of a pool able to be utilized part time, orperiodically (e.g., 1 week every 3-4 weeks) a staffing requirement of1000 providers, it could sustainably be managed for extended periods ofmany months to indefinitely. These 1000 providers could, according tothe estimates above, provide 40,000 to 160,000 consults weekly at steadystate, helping manage a disaster notionally affecting 1-3 million peopleat a time.

Workflow Summary

The system may be configured to provide a large scalable pool ofwilling, highly skilled, geographically diverse, pre-trained providerswill be available on demand at a moment's notice. On-site providers mayaccess the system's network using the telemedicine app when help isneeded and may be routed to the virtual command center for a briefsituational awareness update and credential verification. Bedsideproviders may then create accounts and register patients in real-timeafter a verification code is sent to them from the command center usinga standard 2 Factor Authentication process. After registering a patient,the bedside provider may send out a message (e.g., standard, urgent, orSOS options for triage purposes) via the App including a brief patientdescription and situational details. This message may be visible to ALLremote Intensivists who are logged in to the App (e.g., providersrecruited after a situational alert from bedside). Any intensivist canthen accept the consultation request and may be then directly connectedto the bedside provider. The providers may formulate a care plantogether using Audio-Video and/or text communication in real-time.Providers may also be able to upload images to assist with treatmentdecisions.

Furthermore, additional clinical information in the form of vital signsand acuity scores may be visible to the Intensivist based on the initialinformation provided by the bedside provider. An exemplary acuity scoreproposed in at least some embodiments may be the NEWS score, which canbe calculated in real-time by the Application, based on vital signinformation for a given patient as described herein. The patients maythen be color coded (e.g., Red=High Acuity, Yellow=Medium AcuityGreen=Low Acuity) within the App and thereby enable a severity ofillness based triaging mechanism for the remote providers, who canprioritize requests based on the acuity score. Given that automatedacuity scores are not always reflective of true severity, the App mayalso enable a manual override of the system generated acuity.

In the most austere situations, the bedside provider could manuallyenter vital signs into the App OR connect a wearable device to thetelemedicine App. The telemedicine App may be configured to communicatewith wearable devices, such as Athena GTX or other devices from whichreal-time data can be retrieved. The ability to view vital signs mayenable remote Intensivists to quickly make triage decisions and enabletransfer of patients to a higher level of care if required, andprioritize the consults within the telemedicine system as well.

The telemedicine system and methods described herein may facilitatecollaboration between multiple Critical Care providers.Multi-disciplinary teams can be created (the ideal composition of eachteam consists of a remote Intensivist, RN, RT and Pharmacist) usingreal-time knowledge of the number of available professionals using thesystem dashboard as described herein.

Team creation may be a dynamic function that takes into account thecomplexity of cases, provider to patient ratio, and provider efficiency.Using real-time user data from the App which is visible to systemadministrators in the system Virtual Command Center, decisions can bemade using a combination of machine learning and manual processes tooptimize functionality of the system. Team functionality may also enablepatient handoffs to ensure appropriate continuity of care as describedherein.

Provider efficiency and productivity may be tracked within the systembased on the processing time for various consults. This metric may formthe basis for dynamic reassignment of patients between providers andteams using a combination of automated SLA algorithms and manualprocesses as required.

Following the Tele Critical Care evaluation of the patient, the remoteIntensivist may complete the consultation with a formal summary note,which can be exported to the EMR of the patient.

The system may be configured to integrate with both medical recordsystems and device data aggregators (such as DocBox, etc.). Thiscapability may allow the remote intensivists to have a comprehensiveaggregated view of real-time data from multiple bedside devices, whichmay facilitate complex care decisions as patients move into higherlevels of care. During the transition from a non-hospital location tohospital location, patient data may be archived, stored, and remainretrievable to create a longitudinal integrated care record.

The systems and methods described herein can integrate with bedside andwearable monitoring and biosensor devices, which may continuouslytransmit key patient data, with real-time data optionally displayed onthe App to immediately identify and transmit significant deviations fromsettable thresholds. Flow of information to providers may be supportedby automated algorithms that provide information batching, providerresponse suggestions, flagging of overdue requests, identification ofdangerous vital signs, and adverse events data. Data may be visuallydisplayed to allow providers to easily process it. On-site besideproviders can prioritize and communicate the urgency of their supportneeds via the software. The network of remote providers can then viewthe streamed data in real-time and use the software to prioritize andcommunicate (via secure messaging or audio-video) with on-site providers(or patients) to ensure timely responses to support needs. Thetelemedicine App and infrastructure on the backend may supportmulti-connectivity communications protocols. This may allow a device orwearable paired with the telemedicine App client/user (e.g., on-siteprovider or patient) to harness available communication links at a givenlocation. These links can be aggregated to provide a thick pipe to thecloud infrastructure on which high-bandwidth, low-latency data streamscan be transferred reliably and efficiently, analyzed, and displayed foruse by on-site and remote providers and command center personnel. Theresult may be high availability across networks and geographies ofhigh-definition and high-resolution data for decision support.

Data Collection and Management

FIG. 25 shows a schematic drawing of a system for data collection andmanagement using a telemedicine system. The telemedicine systemdescribed herein may provide a platform for meaningful medical deviceinteroperability that may enable advances that medicine needs to improvehealthcare both clinically and operationally. The data model may bedesigned to facilitate and enable its use as shown in FIG. 16. Theprimary functions of the telemedicine system described herein areproviding specific clinical and operational insights in real-time,providing the ability for tele-critical care, and provisioning ofoperational data for situational awareness. These operational insightsmay include: the number of patients are currently on ventilators and thenumber of ventilators remain available; the number of beds are availableat an ad hoc site; the types of medications are being used; therelationship between use of a medication and discharge time. Theseinsights may be created from the data collected during the patient stay.Retrospectively, this data from this common database can be used forresearch purposes, and also to implement automation into the system toassist in the response. In some embodiments, these operational insightsmay be studied, labelled, and fed into a machine learning algorithm toimprove future operation.

The system may be configured to connect, via a distributed and scalableIoT platform, to any vendor medical devices including monitors, bodysensors, ventilator, infusion pumps and to provide near real timemonitoring to remote expert care teams, and/or cybersecurity to medicaldevices. The system may automatically collect, aggregate, normalize,and/or stores real-time data at the bedside and on a Data Cluster. Then,it may communicate this data in near real-time to the TCC Virtual DataSpace (e.g., as shown in FIG. 15). The TCC Virtual Data space may enabledata to flow to multiple applications simultaneously. The data can flowto both the application and simultaneously to regional and nationalreporting dashboards. This capability also means that multipletelemedicine sites with different vendors may consult on the samepatient both simultaneously and asynchronously.

FIG. 26 shows an architecture for the telemedicine platform. As shown inFID. 26, the telemedicine platform may include a number of componentscollaborating with one another to provide seamless, efficient userexperience and better care for patients. In some embodiments, thetelemedicine platform may comprise an app engine server 2602. The appengine service 2602 may coordinate with other components of thetelemedicine platform to provide various functions, as describedelsewhere herein. For example, the app engine service 2602 maycoordinate with a logging element 2616 to facilitate user log inprocess. In an example, the app engine server 2602 may coordinate with areal-time voice and video engagement server 2601 a (e.g., Agora server)to facilitate an audio and/or video communication between users. In anexample, the app engine server 2602 may coordinate with a sendgrid 2601b to send text-based (e.g., email) communication to a user. In anexample, the app engine 2602 may coordinate with a cloud-based server2601 c (e.g., Twillio) to send SMS or other communications to a user.The above operations may facilitate a mobile application to provide thevarious interfaces (as described elsewhere herein) to different usersvia a mobile application element 2610 (e.g., android or iOS devices).These interfaces may be compatible with any web browser application,mobile application, or other applications used by a user of a clientnode. In some embodiments, the interface may provide patient details,vital signs, lab results, etc. to a cloud IAM, and the cloud IAM mayrelay this information to the app engine server 2602. In someembodiments, the cloud IAM may relay this information to an adminportal/dashboard 2608.

The app engine server 2602 may communicate, wired or wirelessly, with adatabase 2604 to store or fetch data. The database 2604 may communicatewith cloud storage to backup data and restore data from the cloudstorage. In some embodiments, the cloud storage is communicativelycoupled to an administrative hosting module 2606. The administrativehosting module 2606 may comprise some sub-components, such as real-timeDB, push notification, hosting, and storage. The administrative hostingmodule 2606 may provide an administrative portal and/or dashboard 2608for a user. The functionalities of administrative portal and/ordashboard 2608 are described elsewhere herein. In some embodiments, theadministrative portal and/or dashboard may communicate directly with themobile application module to provide administrative level interfaces toa user, as described elsewhere herein. In some embodiments, the appengine 2602 may utilize a compute engine 2612 to pull docbox informationfor patients and the vital signs of a patient from a docbox 2614. Insome embodiments, the docbox 2614 may comprise an external API tofacilitate documents search and transfer.

FIG. 27 is a block diagram depicting an example system 2700, accordingto embodiments of the present disclosure, comprising a client-serverarchitecture and network configuration to perform the various methodsdescribed herein. A platform (e.g., machines and software, possiblyinteroperating via a series of network connections, protocols,application-level interfaces, and so on), in the form of a serverplatform 1020, provides server-side functionality via a communicationnetwork 1014 (e.g., the Internet or other types of wide-area networks(WANs), such as wireless networks or private networks with additionalsecurity appropriate to tasks performed by a user) to one or more clientnodes 1002, 1006, and/or one or more patient—healthcare providerinterfaces (e.g., patient—healthcare provider interface 1030). FIG. 27illustrates, for example, a client node 1002 hosting a web extension1004, thus allowing a user to access functions provided by the serverplatform 1020, for example, requesting a consult from the serverplatform 1020, receiving patient data from the server platform 1020,receiving requests of consults relayed by the server platform 1020,sending/receiving communications facilitated by the server platform1020, etc. The web extension 1004 may be compatible with any web browserapplication used by a user of the client node. Further, FIG. 27illustrates, for example, another client node 1006 hosting a mobileapplication 1008, thus allowing a user to access functions provide bythe server platform 1020, for example, requesting a consult from theserver platform 1020, receiving patient data from the server platform1020, receiving requests of consults relayed by the server platform1020, sending/receiving communications facilitated by the serverplatform 1020, etc. Delivery may be through a wired or wireless mode ofcommunication. Examples of communications may be in the form of messages(e.g., in-app messaging or via external text messaging systems),audio-video calls (e.g., in-app calls or to an external phone number),orders, notes, and the like.

A client node (e.g., client node 1002 and/or client node 1006) may be,for example, a user device (e.g., mobile electronic device, stationaryelectronic device, etc.). A client node may be associated with, and/orbe accessible to, a user. In another example, a client node may be acomputing device (e.g., server) accessible to, and/or associated with,an individual or entity. A node may comprise a network module (e.g.,network adaptor) configured to transmit and/or receive data. Via thenodes in the computer network, multiple users and/or servers maycommunicate and exchange data, such as patient data, vital signs, labresults, patient—healthcare provider communications, etc. In someinstances, the client nodes may receive and present to a user data item(e.g., an image of a patient, a virtual meeting session, a doctor'sorder, etc.). The client nodes may also gather data associated with apatient and transmit the data to the server platform 1020 (e.g., patientvital signs data, acuity level, etc.). In some embodiments, the clientnodes may facilitate an onboarding process, as described elsewhereherein, for a patient, a bedside caregiver, and/or a healthcareproviders. Alternatively or additionally, the client nodes may includevirtual reality (VR) devices, via which a VR environment may bepresented to a remote healthcare provider, wherein the VR environmentmay comprise images of a patient, video feeds of a patient, one or morecontrols that may enable the healthcare provider to control the VRenvironment. The video feeds may be obtained by one or more sensorslocated near the patient. Alternatively or additionally, the video feedsmay be obtained by cameras. The video feeds may include audio feedsassociated with the environment of the patient. Alternatively oradditionally, the audio feeds may be interactive (e.g., bidirectional),which may enable an interaction (e.g., conversation) between a subject(e.g., bedside caregiver, a patient, etc.) and a user (e.g., a doctor ordoctor's assistant).

In at least some examples, the server platform 1020 may be one or morecomputing devices or systems, storage devices, and other components thatinclude, or facilitate the operation of, various execution modulesdepicted in FIG. 27. These modules may include, for example, healthcareprovider matching engine 1024, interactive communication delivery engine1026, healthcare provider management module 1028, data access modules1042, and data storage 1050. Each of these modules is described ingreater detail below.

The healthcare provider management module 1028 may receive and managehealthcare providers. The healthcare providers, in some embodiments, maycomprise a list of healthcare providers and their affiliated hospitals.In some embodiments, the healthcare providers are grouped based on theiraffiliated hospitals. In some embodiments, the healthcare providermanagement module 1028 may receive profile and/or credential associatedwith the healthcare providers. In an example, such profile may includehealthcare provider's specialties, current workload, diagnose accuracyhistory data, average time spent on a patient, patient's review score,etc. These information may be collected via self-filled forms, hospitalrecord for the healthcare providers, registered information withAmerican Medical Association, past completed consults, etc. Thisinformation may help the server platform 1020 to target the cluster ofhealthcare providers that may provide optimal results for a particularconsult. Additionally, this information may also help the serverplatform 1020 to reduce traffic via the computer network 1014 whenbroadcasting a consult request from a bedside caregiver or a patient.

The healthcare provider matching engine 1024 may match the healthcareproviders as set forth by the information on their profiles. In someembodiments, the healthcare provider matching engine 1024 of the serverplatform 1020 may receive information associated with a requestedconsult from the client node 1002 or 1004, as described elsewhereherein. For example, the client nodes may send a consult regarding apatient who is experiencing short of breath. The client nodes may thenoperate alone or in connection with the healthcare provider marchingengine 1024 to retrieve health record data associated with the patient(if there is any stored in the data storage 1050). The health recorddata may include past interactions between this patient and otherhealthcare providers, historical test results, current medications thepatient is intaking, diagnostics, etc. The health record data(historical data), combined with the requested consult (i.e., currentcause for requesting a consult), may set up preliminary criteria formatching this consult with a healthcare provider.

Once the criteria are set (with or without patient's health recorddata), the healthcare provider matching engine 1024 may query thehealthcare provider management module 1028 to identify and/or select oneor more healthcare providers that matches the criteria for the consult.Notice that in a time when there are not enough available healthcareproviders, the platform may skip this matching step and broadcast theconsult to the entire network, and then contact all the availablehealthcare providers. The healthcare providers' profile, as describedelsewhere herein, are taken into consideration by one or more matchingalgorithms to identify a number of healthcare providers that match theconsult. In some embodiments, the one or more matching algorithms maycalculate a marching score based on the healthcare providers profilesand the consult. The healthcare providers with a matching score above apre-determined threshold may be considered as matched, and be notifiedwith the consult. The notified healthcare providers may then view andchoose whether or not to accept a consult. Multiple matching algorithmsmay be utilized by the healthcare provider matching engine 1024 toidentify the optimal group of healthcare providers to present to theuser, and it may be operated in real-time. For example, a healthcareprovider (i.e., doctor) who specializes in respiratory conditions and iscurrently in low workload may score a high match score when determiningwhether to match with a consult for a short of breath. A healthcareprovider who specializes in bone fracture conditions and is currently ina high workload may score a low match score when determining whether tomatch with a consult for a short of breath. This matching mechanism maybeneficially reduce the overload of internet traffic when there areabundant healthcare providers are available because it may only send thenotification of this consult to the healthcare providers with a matchscore above a predetermined threshold. In some embodiments, the platformmay allow a consult initiator to set an urgency level for the consult,and if no healthcare provider responds to the consult in a predefinedduration, the platform may broadcast the consult to a bigger group ofhealthcare providers (e.g., the ones with lower matching scores down thelist).

The interactive communication delivery engine 1026 may operate tofacilitate communications between healthcare providers and patient (orbedside caregiver). Once a healthcare provider who views and accepts aconsult, either party may initiate an online communication. Examples ofcommunications may be in the form of messages (e.g., in-app messaging orvia external text messaging systems), audio and/or video calls (e.g.,in-app calls or to an external phone number), orders, notes, and thelike. The audio and/or video calls may be on-demand, i.e., only beinitiated when there is need to. The interactive communication deliveryengine 1026 may operate alone or in connection with patient-healthcareprovider interface 1030 to provide the functionalities for thecommunications. Examples of the interfaces and communications aredescribed elsewhere herein.

Data access modules 1042 may facilitate access to data storage 1050 ofthe server platform 120 by any of the remaining modules 1024, 1026, and1028 of the server platform 120. In one example, one or more of the dataaccess modules 1042 may be database access modules, or may be any kindof data access module capable of storing data to, and/or retrieving datafrom, the data storage 1050 according to the needs of the particularmodule 1024, 126, and 1028 employing the data access modules 1042 toaccess the data storage 1050. Examples of the data storage 1050 include,but are not limited to, one or more data storage components, such asmagnetic disk drives, optical disk drives, solid state disk (SSD)drives, and other forms of nonvolatile and volatile memory components.

In some embodiments, when a patient is treated and recovered from thehealth condition, the data associated with the consult session may beachieved and saved to the data storage 1050. These data may be laterstudied, labelled and fed to a machine learning algorithm. The machinelearning algorithm may train a prediction model which may: predict anational or regional outbreak of a disease; predict a timeline fortreating a patient, provide suggestions (lab tests, medications) to adoctor when a certain consult is received and the patient's vital signsmatches with a number of historical examples, provide suggestions toimprove the one or more matching algorithms, etc. The machine learningalgorithm may comprise one or more of neural networks, Bayesian networks(such as Hidden Markov models), etc. In some embodiments, the machinelearning algorithm may collaborate with one or more decision trees,support vector machine, or other systems to assist one or morepredictions with large numbers of variables, such as the ones describedelsewhere herein.

The system described herein utilizes a patient-centric data model,focusing on a single patient. This provides the ability to easily addmultiple patients that scale the system's data model by addingadditional integrated clinical environment Data Models to the system,which each may equate to a single patient, or consist of a group ofpatients. In some embodiments, the data model may include multipledimensions such as the patient, connected devices/components, time,location, etc. In some embodiments, one important dimensions for telecritical care may be the patient and component values at a specifictime. For situational awareness and dashboard data, the most importantdimensions may be component and location data (what resources areavailable at a location).

In some embodiments, the virtual command center and/or user interfacedashboard may be configured to display patient data in (near) real-timeand/or retrospectively. In some embodiments, the data may bestandardized (e.g., via a standard data dictionary with controlledvocabulary), collected, and aggregated by the system as describedherein. In some embodiments, the system may be configured to update datawhen it receives input from a user and/or connected devices. The systemmay be configured to overwrite the data or create a new, optionallylinked, data entry to allow a user (or the system in the case of machinelearning) to view patient data entries over time as the patient'ssituation evolves.

Augmented/Virtual Reality

In some embodiments, the systems and methods described herein utilizeaugmented reality and/or virtual reality for enhanced communicationsbetween the healthcare provider and the patient. A key component ofTele-ICU services (exchanging health information from a hospitalcritical care unit to another location using via electroniccommunications to provide real-time services to multiple care centersregardless of their locations.) involves mentoring of the bedsideclinicians for clinical procedures and bedside patient datainterpretation. Similar to what occurs on a day to day basis inhospitals with mentoring residents, interns and junior physicians, theplatforms, systems, methods, and software disclosed herein provide aTele-ICU service that can be utilized for training and mentoringclinicians who may not have the appropriate skill level as required forcritical care. Using technology tools such as AR and VR facilitates suchtraining and mentoring for the bedside clinicians by the remoteclinicians.

The AR/VR feature can provide the basis of an augmented audio-visualcall allowing remote guidance of the bedside provider by the remoteprovider, through the use of voice commands by the remote provider tozoom in on areas of interest in the remote provider's field of viewwithout requiring the use of a free hand of the bedside provider,instruction in the use of bedside medical equipment by the remoteprovider, specific guidance for the performance of a clinical task, orany combination thereof. A wide range of clinical scenarios can beadapted for the use of the AR/VR feature. Such interactive real timetools provide tremendous value in the context of complex clinicalscenarios allowing clinicians to function at higher skill levels,eventually translating into better patient outcomes.

FIG. 28A and FIG. 28B show a non-limiting illustrative example of theuse of augmented reality during a consult. FIG. 28A shows that theremote healthcare provider (“intensivist”) and the patient and theirlocal provider (“bedside provider”) are engaged in a secure videocommunication session in which each see the same default view of thepatient, in this case, a live video feed of their arm as recorded by theelectronic device at the local provider (e.g., a tablet or othersuitable device capable of video and audio communications). In thisscenario, the remote healthcare provider taps their screen to indicatesomething to the local provider and/or patient. The tap or any otherinteraction by the remote healthcare provider with their user interfacecan be displayed at the local provider/patient's device via a marker orother visual element. In this example shown on FIG. 28B, the marker isdisplayed on both the remote and local provider digital screens. Themarker and the part of the patient's anatomy that was marked can betracked so that the marker moves along with the anatomical area (e.g.,the patient adjusts their arm). This tracking can be accomplished usingmachine learning and/or computer vision algorithms that are currentlyavailable for image segmentation and labeling. For example, deepconvolutional neural networks are particularly suitable for image-basedanalysis and labeling. The remote healthcare provider can provide audioinstructions in conjunction with the marker, for example, instructingthe local provider to put stitches on the marked portion of the arm orto take a close-up high resolution photo of the region and transmit itto the remote healthcare provider to enable a more detailed view.Although FIG. 28A and FIG. 28B provide one particular illustration ofthe use of augmented reality within the telemedicine systems of thepresent disclosure, other uses of augmented reality are contemplated.

Local Edge Communication

In some embodiments, the systems and methods described herein mayprovide local edge communication. During many mass casualty events,hospitals often resort to paper records or use marking pens to writeinformation directly on the patient because the hospital informationsystems are overwhelmed or too time consuming to use. Often it takes toolong to immediately admit patients or there is no electronic admitsystem available. Therefore, in some embodiments, the systems andmethods described herein may provide a mechanism for data to move withthe patient as a patient is transferred from area to area, with orwithout an internet connection. This mechanism can utilize edgecomputing to improve respond times and/or reduce bandwidth usage, forexample, by moving the storage of the patient's data to the servers,devices, or nodes in the network that are closest to the patient inlocation. As an illustrative example, a USB drive or the patient'ssmartphone may be registered within the system to store their medicalinformation, which may be encrypted to only be accessible by anauthorized system or device within the network. In the case of anelectronic device having a graphic user interface such as a smartphoneor tablet, the data may be stored and managed using a softwareapplication installed on the device, and can be easily accessible by athird party device by presenting a QR code that can be scanned to accessthe information (e.g., a nurse's QR code scanner application on a tabletfor admitting patients). Similarly, relevant medical data may betransmitted to the healthcare provider such as a clinician who hasclaimed or accepted a consult request via edge computing.

Data Dictionary and Controlled Vocabularies

The system may be configured with a controlled vocabulary to ensureconsistent description of concepts, resources, and their attributesacross multiple providers in multiple locations. The controlledvocabulary may be used to normalize medical terms input by users ordevices into a standardized format in order to facilitate data entry,storage, and use. In some embodiments, the system may be configured tocollect data automatically with the integrated clinical environment andcan be used to automatically calculate patient scores (e.g., SOFA andAPACHE scores), record dates and times of machine used, etc. In someembodiments, medical data may be encoded in in SNOMED and LOINC whereappropriate to facilitate patient intake and/or retrospective dataanalysis.

While the foregoing written description of the invention enables one ofordinary skill to make and use what is considered presently to be thebest mode thereof, those of ordinary skill will understand andappreciate the existence of variations, combinations, and equivalents ofthe specific embodiment, method, and examples herein. The inventionshould therefore not be limited by the above described embodiment,method, and examples, but by all embodiments and methods within thescope and spirit of the invention.

What is claimed is:
 1. A computer-implemented system comprising: (a) anetwork element communicatively coupled to a plurality of usercommunication nodes and a list of network entities corresponding tothird parties; (b) one or more computer processors; and (c)non-transitory computer readable storage medium comprising executableinstructions that, when executed by the one or more computer processors,cause the one or more computer processors to: i) receive, from a usercommunication node, an electronic signal comprising a communicationrequest including a request description; ii) select, from the list ofnetwork entities corresponding to third parties, one or more networkentities based at least in part on (i) a parameter profile associatedwith a third party, and (ii) criteria extracted from the communicationrequest including the request description; iii) transmit an electronicsignal, to one or more network entities, the communication requestincluding the request description; iv) receive an action from one of theselected network entities corresponding to third parties in response tothe communication request; and v) provide an interactive communicationpanel to the user communication node and the one of the selected networkentities to facilitate the real-time communication session.
 2. Thesystem of claim 1, wherein the one or more computer processors isfurther caused to aggregate data related to the criteria from aplurality of data sources and processing the data according to astandard format.
 3. The system of claim 2, further comprising performingdata analytics on the data to generate a suggestion for one or moreactions.
 4. The system of claim 3, wherein performing data analyticscomprises processing the data using a machine learning algorithm.
 5. Thesystem of claim 1, wherein the interactive communication panel providesa graphical user interface shown on an interactive touchscreen display.6. The system of claim 5, wherein the interactive communication panelprovides an augmented reality video feed between the user communicationnode and the one of the selected network entities.
 7. The system ofclaim 6, wherein the one or more computer processors is further causedto provide tracking of an object shown in the augmented reality videofeed.
 8. The system of claim 7, wherein the object is tracked using acomputer vision algorithm trained to detect and track the object.
 9. Thesystem of claim 8, wherein the computer vision algorithm comprises animage segmentation algorithm or a machine learning algorithm.
 10. Thesystem of claim 9, wherein the machine learning algorithm is a deepconvolutional neural network.
 11. A computer-implemented method forproviding a real-time network communication session, comprising: (a)receiving, by one or more computer processors, from a user communicationnode, an electronic signal comprising a communication request includinga request description; (b) selecting, by the one or more computerprocessors, from a list of network entities corresponding to thirdparties, one or more network entities based at least in part on (i) aparameter profile associated with a third party, and (ii) criteriaextracted from the communication request including the requestdescription; (c) transmitting an electronic signal, by the one or morecomputer processors, to one or more network entities, the communicationrequest including the request description; (d) receiving, by the one ormore computer processors, an action from one of the selected networkentities corresponding to third parties in response to the communicationrequest; and (e) providing, by the one or more computer processors, aninteractive communication panel to the user communication node and theone of the selected network entities to facilitate the real-timecommunication session.
 12. The computer-implemented method of claim 11,further comprising aggregating data related to the criteria from aplurality of data sources and processing the data according to astandard format.
 13. The computer-implemented method of claim 12,further comprising performing data analytics on the data to generate asuggestion for one or more actions.
 14. The computer-implemented methodof claim 13, wherein performing data analytics comprises processing thedata using a machine learning algorithm.
 15. The computer-implementedmethod of claim 11, wherein the interactive communication panel providesa graphical user interface shown on an interactive touchscreen display.16. The computer-implemented method of claim 15, wherein the interactivecommunication panel provides an augmented reality video feed between theuser communication node and the one of the selected network entities.17. The computer-implemented method of claim 16, further comprisingproviding tracking of an object shown in the augmented reality videofeed.
 18. The computer-implemented method of claim 17, wherein theobject is tracked using a computer vision algorithm trained to detectand track the obj ect.
 19. The computer-implemented method of claim 18,wherein the computer vision algorithm comprises an image segmentationalgorithm or a machine learning algorithm.
 20. The computer-implementedmethod of claim 19, wherein the machine learning algorithm is a deepconvolutional neural network.